Jul 03 00:58:50 devstack cinder-volume[75283]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 00:58:50 devstack cinder-volume[75283]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 00:58:50 devstack cinder-volume[75283]: we strongly recommend against using it for new projects. Jul 03 00:58:50 devstack cinder-volume[75283]: If you are already using Eventlet, we recommend migrating to a different Jul 03 00:58:50 devstack cinder-volume[75283]: framework. For more detail see Jul 03 00:58:50 devstack cinder-volume[75283]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 00:58:50 devstack cinder-volume[75283]: import eventlet # noqa Jul 03 00:58:52 devstack cinder-volume[75283]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 00:58:52 devstack cinder-volume[75283]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 00:58:52 devstack cinder-volume[75283]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 00:58:53 devstack cinder-volume[75283]: INFO dbcounter [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Registered counter for database cinder Jul 03 00:58:53 devstack cinder-volume[75283]: DEBUG oslo_db.sqlalchemy.engines [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75283) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 00:58:53 devstack cinder-volume[75283]: DEBUG dbcounter [-] [75283] Writer thread running {{(pid=75283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 00:58:53 devstack cinder-volume[75283]: INFO cinder.rpc [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 00:58:53 devstack cinder-volume[75283]: INFO cinder.rpc [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 00:58:53 devstack cinder-volume[75283]: DEBUG oslo_db.sqlalchemy.engines [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75283) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 00:58:53 devstack cinder-volume[75283]: INFO cinder.volume.manager [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Determined volume DB was empty at startup. Jul 03 00:58:53 devstack cinder-volume[75283]: DEBUG cinder.volume.manager [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75283) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 00:58:53 devstack cinder-volume[75283]: INFO cinder.volume.manager [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 00:58:53 devstack cinder-volume[75283]: WARNING stevedore.named [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 00:58:53 devstack cinder-volume[75283]: WARNING castellan.key_manager [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 00:58:53 devstack cinder-volume[75283]: WARNING cinder.keymgr.conf_key_mgr [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 00:58:53 devstack cinder-volume[75283]: DEBUG cinder.volume.drivers.lvm [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75283) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_concurrency.processutils [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_concurrency.processutils [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] CMD "cinder-rtstool verify" returned: 0 in 0.450s {{(pid=75283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_db.sqlalchemy.engines [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75283) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 00:58:54 devstack cinder-volume[75283]: INFO cinder.rpc [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 03 00:58:54 devstack cinder-volume[75283]: INFO cinder.rpc [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 03 00:58:54 devstack cinder-volume[75283]: WARNING stevedore.named [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 00:58:54 devstack cinder-volume[75283]: WARNING castellan.key_manager [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 00:58:54 devstack cinder-volume[75283]: INFO cinder.volume.manager [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_db.sqlalchemy.engines [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75283) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 00:58:54 devstack cinder-volume[75283]: INFO oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Starting 1 workers Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Started child 75471 {{(pid=75283) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Full set of CONF: {{(pid=75283) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] ******************************************************************************** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Configuration options gathered from: {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] ================================================================================ {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] allow_availability_zone_fallback = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] allow_compression_on_image_upload = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] allowed_direct_url_schemes = [] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] api_rate_limit = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] auth_strategy = keystone {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] az_cache_duration = 3600 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_availability_zone = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_host = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_name = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_stats_polling_interval = 60 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backup_api_class = cinder.backup.api.API {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backup_name_template = backup-%s {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backup_use_same_host = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backup_use_temp_snapshot = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] chap_password = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] chap_username = {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cinder_internal_tenant_project_id = 7aa2df5985d647cc8a3df3ad688737f3 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cinder_internal_tenant_user_id = ce31013399f347b1a8ed64afa54284a5 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cloned_volume_same_az = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cluster = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] compression_format = gzip {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] compute_api_class = cinder.compute.nova.API {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] config_dir = [] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] config_source = [] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] control_exchange = openstack {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] debug = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] default_availability_zone = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] default_group_type = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] default_volume_type = lvmdriver-1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] disk_geometry = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] driver_client_cert = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] driver_client_cert_key = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] driver_data_namespace = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] driver_ssl_cert_path = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] driver_ssl_cert_verify = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] driver_use_ssl = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] enable_force_upload = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] enable_new_services = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] enable_unsupported_driver = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] enforce_multipath_for_image_xfer = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] filter_function = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance_api_insecure = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance_api_servers = ['http://192.168.122.24/image'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance_api_ssl_compression = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance_ca_certificates_file = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance_catalog_info = image:glance:publicURL {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance_certfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance_keyfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance_num_retries = 3 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance_request_timeout = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] goodness_function = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] graceful_shutdown_timeout = 5 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75471]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] group_api_class = cinder.group.api.API {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] host = devstack {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] image_compress_on_upload = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] image_conversion_address_space_limit = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] image_conversion_cpu_limit = 60 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] image_conversion_disable = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] image_upload_use_cinder_backend = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] image_upload_use_internal_tenant = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] image_volume_cache_enabled = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] image_volume_cache_max_count = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] image_volume_cache_max_size_gb = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] init_host_max_objects_retrieval = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] instance_format = [instance: %(uuid)s] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] iscsi_target_flags = {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] iscsi_write_cache = on {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] iser_helper = tgtadm {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] iser_ip_address = 192.168.122.24 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] iser_port = 3260 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] log_color = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] log_config_append = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] log_dir = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] log_file = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] log_options = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] log_rotate_interval = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] log_rotate_interval_type = days {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] log_rotation_type = none {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] max_age = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] max_logfile_count = 30 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] max_logfile_size_mb = 200 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] max_over_subscription_ratio = 20.0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] message_reap_interval = 86400 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] message_ttl = 2592000 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] migration_create_volume_timeout_secs = 300 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] monkey_patch = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] monkey_patch_modules = [] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] my_ip = 192.168.122.24 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] no_snapshot_gb_quota = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] num_iser_scan_tries = 3 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] num_shell_tries = 3 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] num_volume_device_scan_tries = 3 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] nvmeof_conn_info_version = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] nvmet_ns_id = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] nvmet_port_id = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] osapi_max_limit = 1000 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] osapi_volume_ext_list = [] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] osapi_volume_listen_port = 8776 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] osapi_volume_use_ssl = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] osapi_volume_workers = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] per_volume_size_limit = -1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] periodic_fuzzy_delay = 60 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] periodic_interval = 60 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] public_endpoint = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] publish_errors = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] quota_backup_gigabytes = 1000 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] quota_backups = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] quota_gigabytes = 1000 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] quota_groups = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] quota_snapshots = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] quota_volumes = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] rate_limit_burst = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] rate_limit_except_level = CRITICAL {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] rate_limit_interval = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] reinit_driver_count = 3 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] replication_device = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] report_discard_supported = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] report_interval = 120 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] reservation_clean_interval = 86400 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] reservation_expire = 86400 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] reserved_image_namespaces = [] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] reserved_percentage = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] rpc_response_timeout = 120 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] run_external_periodic_tasks = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] scst_target_driver = iscsi {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] scst_target_iqn_name = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] service_down_time = 720 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] shell_completion = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] snapshot_name_template = snapshot-%s {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] snapshot_same_host = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] split_loggers = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] state_path = /opt/stack/data/cinder {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] storage_availability_zone = nova {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] storage_protocol = iSCSI {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] syslog_log_facility = LOG_USER {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] target_helper = lioadm {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] target_ip_address = 192.168.122.24 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] target_port = 3260 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] target_protocol = iscsi {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] target_secondary_ip_addresses = [] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] trace_flags = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] transport_url = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] until_refresh = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] use_chap_auth = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] use_default_quota_class = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] use_journal = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] use_json = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] use_multipath_for_image_xfer = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] use_stderr = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] use_syslog = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] verify_glance_signatures = enabled {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] volume_api_class = cinder.volume.api.API {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] volume_backend_name = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] volume_clear = zero {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] volume_clear_ionice = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] volume_clear_size = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] volume_copy_bps_limit = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] volume_dd_blocksize = 1M {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] volume_name_template = volume-%s {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] volume_service_inithost_offload = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] volume_usage_audit_period = month {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] zoning_mode = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_concurrency.disable_process_locking = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.auth_section = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.auth_type = password {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.auth_version = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.cache = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.certfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.include_service_catalog = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.insecure = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.interface = public {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.keyfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_password = {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75471]: INFO cinder.volume.manager [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcache_username = {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.region_name = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.service_type = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.backend = dogpile.cache.null {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.backend_argument = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.backend_expiration_time = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.config_prefix = cache.oslo {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.debug_cache_backend = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.enable_retry_client = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.enable_socket_keepalive = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.enabled = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.expiration_time = 600 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.hashclient_retry_attempts = 2 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.memcache_dead_retry = 300 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.memcache_pool_maxsize = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.memcache_sasl_enabled = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.password = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.proxies = [] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.redis_db = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.redis_server = localhost:6379 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.retry_attempts = 2 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.retry_delay = 0.0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.socket_keepalive_count = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.socket_keepalive_idle = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.socket_keepalive_interval = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.socket_timeout = 1.0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.tls_allowed_ciphers = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.tls_cafile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.tls_certfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.tls_enabled = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.tls_keyfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cache.username = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] coordination.backend_url = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.asyncio_connection = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.asyncio_slave_connection = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.backend = sqlalchemy {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.connection = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.connection_debug = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.connection_parameters = {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.connection_recycle_time = 3600 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.connection_trace = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.db_inc_retry_interval = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.db_max_retries = 20 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.db_max_retry_interval = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.db_retry_interval = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.max_overflow = 50 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.max_pool_size = 5 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.max_retries = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.mysql_wsrep_sync_wait = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.pool_timeout = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.retry_interval = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.slave_connection = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.sqlite_synchronous = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.synchronous_reader = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] database.use_db_reconnect = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler.connection_string = messaging:// {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler.enabled = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler.es_doc_type = notification {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler.es_scroll_size = 10000 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler.es_scroll_time = 2m {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler.filter_error_trace = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler.hmac_keys = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler.sentinel_service_name = mymaster {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler.socket_timeout = 0.1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler.trace_requests = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler.trace_sqlalchemy = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler_jaeger.process_tags = {} {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler_jaeger.service_name_prefix = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] profiler_otlp.service_name_prefix = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_policy.enforce_new_defaults = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_policy.enforce_scope = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_policy.policy_default_rule = default {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_policy.policy_file = policy.yaml {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] privsep_osbrick.group = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] privsep_osbrick.helper_command = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] privsep_osbrick.user = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cinder_sys_admin.group = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cinder_sys_admin.helper_command = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] cinder_sys_admin.user = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] service_user.auth_section = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] service_user.auth_type = password {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] service_user.cafile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] service_user.certfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] service_user.collect_timing = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] service_user.insecure = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] service_user.keyfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] service_user.send_service_user_token = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] service_user.split_loggers = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] service_user.timeout = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance.auth_section = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance.auth_type = password {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance.certfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance.collect_timing = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance.insecure = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance.keyfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance.region_name = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance.split_loggers = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] glance.timeout = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.backend_availability_zone = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.chap_password = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.chap_username = {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.disk_geometry = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.driver_client_cert = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.driver_client_cert_key = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.driver_data_namespace = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.driver_use_ssl = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.extra_capabilities = {} {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.filter_function = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.goodness_function = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.iscsi_target_flags = {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.iscsi_write_cache = on {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.iser_helper = tgtadm {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.iser_port = 3260 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.lvm_share_target = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.lvm_type = auto {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.num_shell_tries = 3 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.replication_device = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.report_discard_supported = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.reserved_percentage = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.target_helper = tgtadm {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.target_port = 3260 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.target_protocol = iscsi {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.trace_flags = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.unique_fqdn_network = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.use_chap_auth = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.volume_backend_name = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.volume_clear = zero {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.volume_clear_ionice = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.volume_clear_size = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_reports.file_event_handler = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_reports.log_dir = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.backend_host = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.chap_password = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.chap_username = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.disk_geometry = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.driver_client_cert = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.extra_capabilities = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.filter_function = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.goodness_function = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.iser_helper = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.iser_ip_address = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.iser_port = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.lvm_share_target = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.lvm_type = auto {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.num_shell_tries = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.replication_device = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.report_discard_supported = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.reserved_percentage = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.scst_target_driver = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.storage_protocol = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.target_helper = lioadm {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.target_ip_address = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.target_port = 3260 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.trace_flags = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.use_chap_auth = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.volume_clear = zero {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.volume_clear_size = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] lvmdriver-1.volumes_dir = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.ssl = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack sudo[75475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack sudo[75475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_notifications.driver = [] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_notifications.retry = -1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] key_manager.fixed_key = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.barbican_api_version = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.barbican_endpoint = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.barbican_endpoint_type = public {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.barbican_region_name = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.cafile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:54 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.certfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.collect_timing = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.insecure = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.keyfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.number_of_retries = 60 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.retry_delay = 1 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.send_service_user_token = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.split_loggers = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.timeout = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.verify_ssl = True {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican.verify_ssl_path = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican_service_user.auth_section = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican_service_user.auth_type = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican_service_user.cafile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican_service_user.certfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican_service_user.collect_timing = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican_service_user.insecure = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican_service_user.keyfile = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican_service_user.split_loggers = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] barbican_service_user.timeout = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] vault.approle_role_id = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] vault.approle_secret_id = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] vault.kv_mountpoint = secret {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] vault.kv_path = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] vault.kv_version = 2 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] vault.namespace = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] vault.root_token_id = **** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] vault.ssl_ca_crt_file = None {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] vault.timeout = 60.0 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] vault.use_ssl = False {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:58:55 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] ******************************************************************************** {{(pid=75283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 00:58:55 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.903s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:55 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:55 devstack sudo[75475]: pam_unix(sudo:session): session closed for user root Jul 03 00:58:55 devstack sudo[75722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:58:55 devstack sudo[75722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:58:56 devstack sudo[75722]: pam_unix(sudo:session): session closed for user root Jul 03 00:58:56 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.706s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:56 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 00:58:56 devstack cinder-volume[75471]: INFO cinder.brick.local_dev.lvm [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 03 00:58:56 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:56 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:56 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:56 devstack sudo[75951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:58:56 devstack sudo[75951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:58:57 devstack sudo[75951]: pam_unix(sudo:session): session closed for user root Jul 03 00:58:57 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.778s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:57 devstack cinder-volume[75471]: DEBUG cinder.brick.local_dev.lvm [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75471) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 03 00:58:57 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:57 devstack sudo[76120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:58:57 devstack sudo[76120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:58:58 devstack sudo[76120]: pam_unix(sudo:session): session closed for user root Jul 03 00:58:58 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.085s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:58 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:58 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:58 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:58 devstack sudo[76251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:58:58 devstack sudo[76251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:58:59 devstack sudo[76251]: pam_unix(sudo:session): session closed for user root Jul 03 00:58:59 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.791s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:59 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:59 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:59 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:59 devstack sudo[76257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 03 00:58:59 devstack sudo[76257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:58:59 devstack sudo[76257]: pam_unix(sudo:session): session closed for user root Jul 03 00:58:59 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.679s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:59 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:59 devstack sudo[76262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:58:59 devstack sudo[76262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:00 devstack sudo[76262]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:00 devstack sudo[76269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:59:00 devstack sudo[76269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:01 devstack sudo[76269]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:01 devstack sudo[76281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:59:01 devstack sudo[76281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:02 devstack sudo[76281]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:02 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.779s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:02 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:02 devstack sudo[76284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:59:02 devstack sudo[76284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:02 devstack sudo[76284]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:02 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.773s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:02 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:02 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:02 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:02 devstack sudo[76289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:59:02 devstack sudo[76289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:03 devstack sudo[76289]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:03 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.903s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:03 devstack cinder-volume[75471]: INFO cinder.volume.drivers.lvm [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 03 00:59:03 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:03 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:03 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:03 devstack sudo[76308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:59:03 devstack sudo[76308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:04 devstack sudo[76308]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:04 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.733s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:04 devstack cinder-volume[75471]: DEBUG cinder.volume.drivers.lvm [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Updating volume stats {{(pid=75471) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 00:59:04 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:04 devstack sudo[76417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:59:04 devstack sudo[76417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:04 devstack cinder-volume[75283]: DEBUG dbcounter [-] [75283] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 00:59:05 devstack sudo[76417]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:05 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:05 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:05 devstack sudo[76562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:59:05 devstack sudo[76562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:05 devstack sudo[76562]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:05 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:05 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:05 devstack sudo[76565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:59:05 devstack sudo[76565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:06 devstack sudo[76565]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:06 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:06 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:06 devstack sudo[76568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:59:06 devstack sudo[76568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:07 devstack sudo[76568]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:07 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:07 devstack cinder-volume[75471]: INFO cinder.volume.driver [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Driver hasn't implemented _init_vendor_properties() Jul 03 00:59:07 devstack cinder-volume[75471]: DEBUG cinder.volume.driver [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75471) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 00:59:07 devstack cinder-volume[75471]: DEBUG oslo_db.sqlalchemy.engines [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75471) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 00:59:07 devstack cinder-volume[75471]: DEBUG dbcounter [-] [75471] Writer thread running {{(pid=75471) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 00:59:07 devstack cinder-volume[75471]: DEBUG cinder.db.api [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Building query based on filter {{(pid=75471) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 03 00:59:07 devstack cinder-volume[75471]: DEBUG cinder.image.image_utils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75471) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 00:59:07 devstack cinder-volume[75471]: INFO cinder.keymgr.migration [None req-9c22fb62-760c-4a62-9e5c-f53bd43cabaf None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 00:59:07 devstack cinder-volume[75471]: DEBUG cinder.volume.drivers.lvm [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Updating volume stats {{(pid=75471) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 00:59:07 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:07 devstack sudo[76572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:59:07 devstack sudo[76572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:07 devstack sudo[76572]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:07 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:07 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:07 devstack sudo[76576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:59:07 devstack sudo[76576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:08 devstack sudo[76576]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:08 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:08 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:08 devstack sudo[76580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:59:08 devstack sudo[76580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:09 devstack sudo[76580]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:09 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:09 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:09 devstack sudo[76588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:59:09 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:09 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:09 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:09 devstack cinder-volume[75471]: DEBUG cinder.manager [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Notifying Schedulers of capabilities ... {{(pid=75471) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 00:59:09 devstack cinder-volume[75471]: INFO cinder.volume.manager [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Driver initialization completed successfully. Jul 03 00:59:09 devstack cinder-volume[75471]: INFO cinder.manager [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Initiating service 2 cleanup Jul 03 00:59:09 devstack cinder-volume[75471]: INFO cinder.manager [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Service 2 cleanup completed. Jul 03 00:59:09 devstack cinder-volume[75471]: DEBUG cinder.service [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Creating RPC server for service cinder-volume {{(pid=75471) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 00:59:09 devstack cinder-volume[75471]: DEBUG cinder.service [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75471) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 00:59:10 devstack cinder-volume[75471]: INFO cinder.volume.manager [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 03 00:59:10 devstack cinder-volume[75471]: DEBUG cinder.volume.drivers.lvm [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Updating volume stats {{(pid=75471) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 00:59:10 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:10 devstack sudo[76592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:59:10 devstack sudo[76592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:10 devstack sudo[76592]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:10 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:10 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:10 devstack sudo[76596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:59:10 devstack sudo[76596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:11 devstack sudo[76596]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:11 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:11 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:11 devstack sudo[76599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:59:11 devstack sudo[76599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:12 devstack sudo[76599]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:12 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:12 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:12 devstack sudo[76656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:59:12 devstack sudo[76656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:12 devstack sudo[76656]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:12 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:12 devstack cinder-volume[75471]: INFO cinder.volume.manager [None req-d61635c8-df52-4b9f-9f69-fc30136ff979 None None] Driver post RPC initialization completed successfully. Jul 03 00:59:22 devstack cinder-volume[75471]: DEBUG dbcounter [-] [75471] Writing DB stats cinder:SELECT=4 {{(pid=75471) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 00:59:22 devstack cinder-volume[75471]: DEBUG dbcounter [-] [75471] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75471) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 00:59:59 devstack cinder-volume[75471]: DEBUG oslo_service.periodic_task [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 00:59:59 devstack cinder-volume[75471]: DEBUG cinder.volume.drivers.lvm [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Updating volume stats {{(pid=75471) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 00:59:59 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:59 devstack sudo[78272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:59:59 devstack sudo[78272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:00:00 devstack sudo[78272]: pam_unix(sudo:session): session closed for user root Jul 03 01:00:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:00:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:00:00 devstack sudo[78275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 01:00:00 devstack sudo[78275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:00:01 devstack sudo[78275]: pam_unix(sudo:session): session closed for user root Jul 03 01:00:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:00:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:00:01 devstack sudo[78279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 01:00:01 devstack sudo[78279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:00:01 devstack sudo[78279]: pam_unix(sudo:session): session closed for user root Jul 03 01:00:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.652s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:00:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:00:01 devstack sudo[78282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 01:00:01 devstack sudo[78282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:00:02 devstack sudo[78282]: pam_unix(sudo:session): session closed for user root Jul 03 01:00:02 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.687s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:00:02 devstack cinder-volume[75471]: DEBUG cinder.manager [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Notifying Schedulers of capabilities ... {{(pid=75471) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:00:02 devstack cinder-volume[75471]: DEBUG oslo_service.periodic_task [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running periodic task VolumeManager._thread_info {{(pid=75471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:00:02 devstack cinder-volume[75471]: DEBUG cinder.volume.manager [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] thread count: 6 {{(pid=75471) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:00:02 devstack cinder-volume[75471]: DEBUG cinder.volume.manager [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] thread info: [<_MainThread(MainThread, started 128035717341312)>, , , , , ] {{(pid=75471) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:00:59 devstack cinder-volume[75471]: DEBUG oslo_service.periodic_task [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:00:59 devstack cinder-volume[75471]: DEBUG cinder.volume.drivers.lvm [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Updating volume stats {{(pid=75471) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 01:00:59 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:00:59 devstack sudo[79007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 01:00:59 devstack sudo[79007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:01:00 devstack sudo[79007]: pam_unix(sudo:session): session closed for user root Jul 03 01:01:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:00 devstack sudo[79010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 01:01:00 devstack sudo[79010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:01:00 devstack sudo[79010]: pam_unix(sudo:session): session closed for user root Jul 03 01:01:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:00 devstack sudo[79014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 01:01:00 devstack sudo[79014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:01:01 devstack sudo[79014]: pam_unix(sudo:session): session closed for user root Jul 03 01:01:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.628s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:01 devstack sudo[79044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 01:01:01 devstack sudo[79044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:01:02 devstack sudo[79044]: pam_unix(sudo:session): session closed for user root Jul 03 01:01:02 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:02 devstack cinder-volume[75471]: DEBUG cinder.manager [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Notifying Schedulers of capabilities ... {{(pid=75471) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:01:22 devstack cinder-volume[75471]: DEBUG dbcounter [-] [75471] Writing DB stats cinder:SELECT=1 {{(pid=75471) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:01:22 devstack cinder-volume[75471]: DEBUG dbcounter [-] [75471] Writing DB stats cinder:UPDATE=1 {{(pid=75471) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:01:59 devstack cinder-volume[75471]: DEBUG oslo_service.periodic_task [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:01:59 devstack cinder-volume[75471]: DEBUG cinder.volume.drivers.lvm [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Updating volume stats {{(pid=75471) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 01:01:59 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:59 devstack sudo[82029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 01:01:59 devstack sudo[82029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:02:00 devstack sudo[82029]: pam_unix(sudo:session): session closed for user root Jul 03 01:02:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:02:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:02:00 devstack sudo[82037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 01:02:00 devstack sudo[82037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:02:00 devstack sudo[82037]: pam_unix(sudo:session): session closed for user root Jul 03 01:02:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:02:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:02:00 devstack sudo[82042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 01:02:00 devstack sudo[82042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:02:01 devstack sudo[82042]: pam_unix(sudo:session): session closed for user root Jul 03 01:02:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:02:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:02:01 devstack sudo[82045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 01:02:01 devstack sudo[82045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:02:02 devstack sudo[82045]: pam_unix(sudo:session): session closed for user root Jul 03 01:02:02 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:02:02 devstack cinder-volume[75471]: DEBUG cinder.manager [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Notifying Schedulers of capabilities ... {{(pid=75471) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:02:02 devstack cinder-volume[75471]: DEBUG oslo_service.periodic_task [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running periodic task VolumeManager._thread_info {{(pid=75471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:02:02 devstack cinder-volume[75471]: DEBUG cinder.volume.manager [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] thread count: 6 {{(pid=75471) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:02:02 devstack cinder-volume[75471]: DEBUG cinder.volume.manager [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] thread info: [<_MainThread(MainThread, started 128035717341312)>, , , , , ] {{(pid=75471) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:02:59 devstack cinder-volume[75471]: DEBUG oslo_service.periodic_task [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:02:59 devstack cinder-volume[75471]: DEBUG cinder.volume.drivers.lvm [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Updating volume stats {{(pid=75471) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 01:02:59 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:02:59 devstack sudo[84101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 01:02:59 devstack sudo[84101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:03:00 devstack sudo[84101]: pam_unix(sudo:session): session closed for user root Jul 03 01:03:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:03:00 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:03:00 devstack sudo[84126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 01:03:00 devstack sudo[84126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:03:01 devstack sudo[84126]: pam_unix(sudo:session): session closed for user root Jul 03 01:03:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:03:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:03:01 devstack sudo[84168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 01:03:01 devstack sudo[84168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:03:01 devstack sudo[84168]: pam_unix(sudo:session): session closed for user root Jul 03 01:03:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.678s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:03:01 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:03:01 devstack sudo[84191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 01:03:01 devstack sudo[84191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:03:02 devstack sudo[84191]: pam_unix(sudo:session): session closed for user root Jul 03 01:03:02 devstack cinder-volume[75471]: DEBUG oslo_concurrency.processutils [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=75471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:03:02 devstack cinder-volume[75471]: DEBUG cinder.manager [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Notifying Schedulers of capabilities ... {{(pid=75471) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:03:02 devstack cinder-volume[75471]: DEBUG oslo_service.periodic_task [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running periodic task VolumeManager._thread_info {{(pid=75471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:03:02 devstack cinder-volume[75471]: DEBUG cinder.volume.manager [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] thread count: 6 {{(pid=75471) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:03:02 devstack cinder-volume[75471]: DEBUG cinder.volume.manager [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] thread info: [<_MainThread(MainThread, started 128035717341312)>, , , , , ] {{(pid=75471) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:03:22 devstack cinder-volume[75471]: DEBUG dbcounter [-] [75471] Writing DB stats cinder:SELECT=1 {{(pid=75471) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:03:22 devstack cinder-volume[75471]: DEBUG dbcounter [-] [75471] Writing DB stats cinder:UPDATE=1 {{(pid=75471) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:03:59 devstack cinder-volume[75471]: DEBUG oslo_service.periodic_task [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] Running periodic task VolumeManager._thread_info {{(pid=75471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:03:59 devstack cinder-volume[75471]: DEBUG cinder.volume.manager [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] thread count: 6 {{(pid=75471) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:03:59 devstack cinder-volume[75471]: DEBUG cinder.volume.manager [None req-b3809ef1-aff6-4cf6-b3df-25b730d82065 None None] thread info: [<_MainThread(MainThread, started 128035717341312)>, , , , , ] {{(pid=75471) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:04:02 devstack cinder-volume[75283]: INFO oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Caught SIGTERM, stopping children Jul 03 01:04:02 devstack cinder-volume[75283]: DEBUG oslo_concurrency.lockutils [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Acquiring lock "singleton_lock" {{(pid=75283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 01:04:02 devstack cinder-volume[75283]: DEBUG oslo_concurrency.lockutils [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Acquired lock "singleton_lock" {{(pid=75283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 01:04:02 devstack cinder-volume[75283]: DEBUG oslo_concurrency.lockutils [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Releasing lock "singleton_lock" {{(pid=75283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 01:04:02 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Stop services. {{(pid=75283) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 01:04:02 devstack cinder-volume[75283]: DEBUG oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Killing children. {{(pid=75283) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 01:04:02 devstack cinder-volume[75283]: INFO oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Waiting on 1 children to exit Jul 03 01:04:05 devstack cinder-volume[75471]: DEBUG oslo_concurrency.lockutils [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Acquiring lock "singleton_lock" {{(pid=75471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 01:04:05 devstack cinder-volume[75471]: DEBUG oslo_concurrency.lockutils [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Acquired lock "singleton_lock" {{(pid=75471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 01:04:05 devstack cinder-volume[75471]: DEBUG oslo_concurrency.lockutils [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Releasing lock "singleton_lock" {{(pid=75471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 01:04:05 devstack cinder-volume[75471]: WARNING amqp [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 01:04:05 devstack cinder-volume[75471]: WARNING amqp [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 01:04:05 devstack cinder-volume[75283]: INFO oslo_service.backend._eventlet.service [None req-c6aba855-d0b8-474b-aa9a-3ed804ef8403 None None] Child 75471 exited with status 0 Jul 03 01:04:05 devstack cinder-volume[85627]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 01:04:05 devstack cinder-volume[85627]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 01:04:05 devstack cinder-volume[85627]: we strongly recommend against using it for new projects. Jul 03 01:04:05 devstack cinder-volume[85627]: If you are already using Eventlet, we recommend migrating to a different Jul 03 01:04:05 devstack cinder-volume[85627]: framework. For more detail see Jul 03 01:04:05 devstack cinder-volume[85627]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 01:04:05 devstack cinder-volume[85627]: import eventlet # noqa Jul 03 01:04:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 01:04:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 01:04:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 01:04:08 devstack cinder-volume[85627]: INFO dbcounter [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Registered counter for database cinder Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_db.sqlalchemy.engines [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85627) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG dbcounter [-] [85627] Writer thread running {{(pid=85627) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 01:04:08 devstack cinder-volume[85627]: INFO cinder.rpc [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 01:04:08 devstack cinder-volume[85627]: INFO cinder.rpc [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_db.sqlalchemy.engines [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85627) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:04:08 devstack cinder-volume[85627]: INFO cinder.volume.manager [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Determined volume DB was empty at startup. Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG cinder.volume.manager [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85627) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 01:04:08 devstack cinder-volume[85627]: INFO cinder.volume.manager [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 01:04:08 devstack cinder-volume[85627]: WARNING stevedore.named [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 01:04:08 devstack cinder-volume[85627]: WARNING castellan.key_manager [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 01:04:08 devstack cinder-volume[85627]: WARNING cinder.keymgr.conf_key_mgr [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 01:04:08 devstack cinder-volume[85627]: INFO cinder.volume.manager [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_db.sqlalchemy.engines [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85627) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:04:08 devstack cinder-volume[85627]: INFO oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Starting 1 workers Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Started child 85842 {{(pid=85627) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Full set of CONF: {{(pid=85627) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] ******************************************************************************** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Configuration options gathered from: {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] ================================================================================ {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] allow_availability_zone_fallback = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] allow_compression_on_image_upload = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] allowed_direct_url_schemes = [] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] api_rate_limit = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] auth_strategy = keystone {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_availability_zone = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_host = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_name = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_stats_polling_interval = 60 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backup_api_class = cinder.backup.api.API {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backup_name_template = backup-%s {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backup_use_same_host = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backup_use_temp_snapshot = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] chap_password = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] chap_username = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cinder_internal_tenant_project_id = 7aa2df5985d647cc8a3df3ad688737f3 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cinder_internal_tenant_user_id = ce31013399f347b1a8ed64afa54284a5 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cluster = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85842]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] compression_format = gzip {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] compute_api_class = cinder.compute.nova.API {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] config_dir = [] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] config_source = [] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] control_exchange = openstack {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] debug = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] default_availability_zone = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] default_group_type = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] default_volume_type = QuobyteHD {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] disk_geometry = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] driver_client_cert = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] driver_client_cert_key = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] driver_data_namespace = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] driver_ssl_cert_path = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] driver_ssl_cert_verify = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] driver_use_ssl = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] enable_new_services = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] enable_unsupported_driver = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] enabled_backends = ['QuobyteHD'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] enforce_multipath_for_image_xfer = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] filter_function = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance_api_insecure = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance_api_servers = ['http://192.168.122.24/image'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance_api_ssl_compression = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance_ca_certificates_file = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance_catalog_info = image:glance:publicURL {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance_certfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance_keyfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance_num_retries = 3 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance_request_timeout = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] goodness_function = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] graceful_shutdown_timeout = 5 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] group_api_class = cinder.group.api.API {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] host = devstack {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] image_compress_on_upload = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] image_conversion_address_space_limit = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] image_conversion_cpu_limit = 60 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] image_conversion_disable = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] image_upload_use_cinder_backend = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] image_upload_use_internal_tenant = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] image_volume_cache_enabled = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] image_volume_cache_max_count = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] image_volume_cache_max_size_gb = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] init_host_max_objects_retrieval = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] instance_format = [instance: %(uuid)s] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] iscsi_target_flags = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] iscsi_write_cache = on {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] iser_helper = tgtadm {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] iser_ip_address = 192.168.122.24 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] iser_port = 3260 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] log_color = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] log_config_append = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] log_dir = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] log_file = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] log_options = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] log_rotate_interval = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] log_rotate_interval_type = days {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] log_rotation_type = none {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] max_age = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] max_logfile_count = 30 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] max_logfile_size_mb = 200 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] max_over_subscription_ratio = 20.0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] message_reap_interval = 86400 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] message_ttl = 2592000 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] migration_create_volume_timeout_secs = 300 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] monkey_patch = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] monkey_patch_modules = [] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] my_ip = 192.168.122.24 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] no_snapshot_gb_quota = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] num_iser_scan_tries = 3 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] num_shell_tries = 3 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] num_volume_device_scan_tries = 3 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] nvmeof_conn_info_version = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] nvmet_ns_id = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] nvmet_port_id = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] osapi_max_limit = 1000 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] osapi_volume_ext_list = [] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] osapi_volume_listen_port = 8776 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] osapi_volume_use_ssl = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] osapi_volume_workers = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] per_volume_size_limit = -1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] periodic_fuzzy_delay = 60 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] periodic_interval = 60 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] public_endpoint = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] publish_errors = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] quota_backup_gigabytes = 1000 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] quota_backups = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] quota_gigabytes = 1000 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] quota_groups = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] quota_snapshots = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] quota_volumes = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] rate_limit_burst = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] rate_limit_except_level = CRITICAL {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] rate_limit_interval = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] reinit_driver_count = 3 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] replication_device = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] report_discard_supported = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] report_interval = 120 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] reservation_clean_interval = 86400 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] reservation_expire = 86400 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] reserved_image_namespaces = [] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] reserved_percentage = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] rpc_response_timeout = 120 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] run_external_periodic_tasks = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] scst_target_driver = iscsi {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] scst_target_iqn_name = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] service_down_time = 720 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] shell_completion = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] snapshot_name_template = snapshot-%s {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] split_loggers = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] state_path = /opt/stack/data/cinder {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] storage_availability_zone = nova {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] storage_protocol = iSCSI {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] syslog_log_facility = LOG_USER {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] target_helper = lioadm {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] target_ip_address = 192.168.122.24 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] target_port = 3260 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] target_protocol = iscsi {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] target_secondary_ip_addresses = [] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] trace_flags = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] transport_url = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] until_refresh = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] use_chap_auth = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] use_default_quota_class = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] use_journal = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] use_json = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] use_multipath_for_image_xfer = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] use_stderr = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] use_syslog = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] verify_glance_signatures = enabled {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] volume_api_class = cinder.volume.api.API {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] volume_backend_name = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] volume_clear = zero {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] volume_clear_ionice = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] volume_clear_size = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] volume_copy_bps_limit = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] volume_dd_blocksize = 1M {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] volume_name_template = volume-%s {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] volume_service_inithost_offload = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] volume_usage_audit_period = month {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] zoning_mode = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_concurrency.disable_process_locking = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85842]: INFO cinder.volume.manager [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.auth_section = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85842]: DEBUG cinder.volume.drivers.remotefs [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85842) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.auth_type = password {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.auth_version = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.cache = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.certfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.include_service_catalog = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.insecure = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.interface = public {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.keyfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_password = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcache_username = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.region_name = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.service_type = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.backend = dogpile.cache.null {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.backend_argument = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.backend_expiration_time = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.config_prefix = cache.oslo {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.debug_cache_backend = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.enable_retry_client = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.enable_socket_keepalive = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.enabled = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.expiration_time = 600 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.hashclient_retry_attempts = 2 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.memcache_dead_retry = 300 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.memcache_pool_maxsize = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.memcache_sasl_enabled = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.password = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.proxies = [] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.redis_db = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.redis_server = localhost:6379 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.retry_attempts = 2 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.retry_delay = 0.0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.socket_keepalive_count = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.socket_keepalive_idle = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.socket_keepalive_interval = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.socket_timeout = 1.0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.tls_allowed_ciphers = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.tls_cafile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.tls_certfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.tls_enabled = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.tls_keyfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cache.username = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] coordination.backend_url = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.asyncio_connection = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.asyncio_slave_connection = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.backend = sqlalchemy {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.connection = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.connection_debug = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.connection_parameters = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.connection_recycle_time = 3600 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.connection_trace = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.db_inc_retry_interval = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.db_max_retries = 20 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.db_max_retry_interval = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.db_retry_interval = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.max_overflow = 50 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.max_pool_size = 5 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.max_retries = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.mysql_wsrep_sync_wait = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.pool_timeout = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.retry_interval = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.slave_connection = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.sqlite_synchronous = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.synchronous_reader = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] database.use_db_reconnect = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler.connection_string = messaging:// {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler.enabled = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler.es_doc_type = notification {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler.es_scroll_size = 10000 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler.es_scroll_time = 2m {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler.filter_error_trace = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler.hmac_keys = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler.sentinel_service_name = mymaster {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler.socket_timeout = 0.1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler.trace_requests = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler.trace_sqlalchemy = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler_jaeger.process_tags = {} {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler_jaeger.service_name_prefix = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] profiler_otlp.service_name_prefix = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_policy.enforce_new_defaults = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_policy.enforce_scope = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_policy.policy_default_rule = default {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_policy.policy_file = policy.yaml {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] privsep_osbrick.group = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] privsep_osbrick.helper_command = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] privsep_osbrick.user = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cinder_sys_admin.group = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cinder_sys_admin.helper_command = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] cinder_sys_admin.user = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] service_user.auth_section = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] service_user.auth_type = password {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] service_user.cafile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] service_user.certfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] service_user.collect_timing = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] service_user.insecure = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] service_user.keyfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] service_user.send_service_user_token = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] service_user.split_loggers = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] service_user.timeout = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance.auth_section = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance.auth_type = password {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance.certfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance.collect_timing = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance.insecure = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance.keyfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance.region_name = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance.split_loggers = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] glance.timeout = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.backend_availability_zone = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.chap_password = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.chap_username = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.disk_geometry = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.driver_client_cert = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.driver_client_cert_key = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.driver_data_namespace = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.driver_use_ssl = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.extra_capabilities = {} {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.filter_function = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.goodness_function = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.iscsi_target_flags = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.iscsi_write_cache = on {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.iser_helper = tgtadm {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.iser_port = 3260 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.nas_host = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.nas_login = admin {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.nas_mount_options = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.nas_password = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.nas_private_key = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.nas_share_path = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.num_shell_tries = 3 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.quobyte_volume_url = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.replication_device = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.report_discard_supported = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85842]: DEBUG cinder.volume.drivers.quobyte [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85842) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 01:04:08 devstack cinder-volume[85842]: WARNING cinder.volume.drivers.quobyte [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 01:04:08 devstack cinder-volume[85842]: WARNING cinder.volume.drivers.quobyte [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.reserved_percentage = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85842]: DEBUG oslo_concurrency.processutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Running cmd (subprocess): mount.quobyte {{(pid=85842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:08 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.target_helper = tgtadm {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.target_port = 3260 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.target_protocol = iscsi {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.trace_flags = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.unique_fqdn_network = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.use_chap_auth = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.volume_backend_name = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.volume_clear = zero {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.volume_clear_ionice = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.volume_clear_size = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_reports.file_event_handler = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_reports.log_dir = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.backend_availability_zone = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.backend_host = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.chap_password = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.chap_username = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.chiscsi_conf = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.disk_geometry = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.driver_client_cert = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.driver_data_namespace = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.driver_use_ssl = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.extra_capabilities = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.filter_function = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.goodness_function = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.iser_helper = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.iser_ip_address = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.iser_port = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.iser_target_prefix = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.nas_host = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.nas_login = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.nas_mount_options = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.nas_password = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.nas_private_key = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.nas_share_path = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.nas_ssh_port = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.num_shell_tries = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.nvmet_port_id = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.replication_device = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.report_discard_supported = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.reserved_percentage = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.scst_target_driver = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.storage_protocol = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.target_helper = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.target_ip_address = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.target_port = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.target_prefix = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.target_protocol = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.trace_flags = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.use_chap_auth = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.volume_clear = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.volume_clear_size = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] QuobyteHD.volumes_dir = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.ssl = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_notifications.driver = [] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_notifications.retry = -1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] key_manager.fixed_key = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.barbican_api_version = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.barbican_endpoint = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.barbican_endpoint_type = public {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.barbican_region_name = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.cafile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.certfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.collect_timing = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.insecure = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.keyfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.number_of_retries = 60 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.retry_delay = 1 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.send_service_user_token = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.split_loggers = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.timeout = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.verify_ssl = True {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican.verify_ssl_path = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican_service_user.auth_section = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican_service_user.auth_type = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican_service_user.cafile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican_service_user.certfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican_service_user.collect_timing = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican_service_user.insecure = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican_service_user.keyfile = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican_service_user.split_loggers = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] barbican_service_user.timeout = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] vault.approle_role_id = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] vault.approle_secret_id = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] vault.kv_mountpoint = secret {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] vault.kv_path = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] vault.kv_version = 2 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] vault.namespace = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] vault.root_token_id = **** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] vault.ssl_ca_crt_file = None {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] vault.timeout = 60.0 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] vault.use_ssl = False {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:09 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] ******************************************************************************** {{(pid=85627) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 01:04:09 devstack quobyte-client[85843]: Reading configuration file: /etc/quobyte/client.cfg Jul 03 01:04:09 devstack quobyte-client[85843]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 03 01:04:09 devstack cinder-volume[85842]: DEBUG oslo_concurrency.processutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] CMD "mount.quobyte" returned: 1 in 0.128s {{(pid=85842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:09 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:04:09 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:04:09 devstack cinder-volume[85842]: DEBUG cinder.volume.drivers.quobyte [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=85842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:04:09 devstack cinder-volume[85842]: INFO cinder.volume.drivers.quobyte [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a ... Jul 03 01:04:09 devstack cinder-volume[85842]: DEBUG oslo_concurrency.processutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 -c /etc/quobyte/client-cinder.cfg {{(pid=85842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:09 devstack sudo[85848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 -c /etc/quobyte/client-cinder.cfg Jul 03 01:04:09 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:09 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:09 devstack cinder-volume[85842]: DEBUG oslo_concurrency.processutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.764s {{(pid=85842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:09 devstack cinder-volume[85842]: INFO cinder.volume.drivers.quobyte [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a succeeded Jul 03 01:04:09 devstack cinder-volume[85842]: DEBUG cinder.volume.drivers.quobyte [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=85842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:04:09 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.774s {{(pid=85842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:04:09 devstack cinder-volume[85842]: DEBUG oslo_concurrency.processutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=85842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:09 devstack sudo[85917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:04:09 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:10 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:10 devstack cinder-volume[85842]: DEBUG oslo_concurrency.processutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.692s {{(pid=85842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:10 devstack cinder-volume[85842]: INFO cinder.volume.driver [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Driver hasn't implemented _init_vendor_properties() Jul 03 01:04:10 devstack cinder-volume[85842]: DEBUG cinder.volume.driver [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7570877075195, 'free_capacity_gb': 1775.7570877075195, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85842) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 01:04:10 devstack cinder-volume[85842]: DEBUG oslo_db.sqlalchemy.engines [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85842) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:04:10 devstack cinder-volume[85842]: DEBUG dbcounter [-] [85842] Writer thread running {{(pid=85842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 01:04:10 devstack cinder-volume[85842]: DEBUG cinder.db.api [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Building query based on filter {{(pid=85842) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 03 01:04:10 devstack cinder-volume[85842]: DEBUG cinder.image.image_utils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85842) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 01:04:10 devstack cinder-volume[85842]: INFO cinder.keymgr.migration [None req-bcf630ce-b3dc-4ee1-85bb-eecfa9096607 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 01:04:10 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:04:10 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:04:10 devstack cinder-volume[85842]: DEBUG cinder.volume.drivers.quobyte [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=85842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:04:10 devstack cinder-volume[85842]: DEBUG cinder.volume.drivers.quobyte [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=85842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:04:10 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:04:10 devstack cinder-volume[85842]: DEBUG oslo_concurrency.processutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=85842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:10 devstack sudo[85921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:04:10 devstack sudo[85921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:11 devstack sudo[85921]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:11 devstack cinder-volume[85842]: DEBUG oslo_concurrency.processutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.649s {{(pid=85842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:11 devstack cinder-volume[85842]: DEBUG cinder.manager [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Notifying Schedulers of capabilities ... {{(pid=85842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:04:11 devstack cinder-volume[85842]: INFO cinder.volume.manager [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Driver initialization completed successfully. Jul 03 01:04:11 devstack cinder-volume[85842]: INFO cinder.manager [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Initiating service 3 cleanup Jul 03 01:04:11 devstack cinder-volume[85842]: INFO cinder.manager [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Service 3 cleanup completed. Jul 03 01:04:11 devstack cinder-volume[85842]: DEBUG cinder.service [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Creating RPC server for service cinder-volume {{(pid=85842) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 01:04:11 devstack cinder-volume[85842]: DEBUG cinder.service [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85842) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 01:04:11 devstack cinder-volume[85842]: INFO cinder.volume.manager [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 01:04:11 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:04:11 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:04:11 devstack cinder-volume[85842]: DEBUG cinder.volume.drivers.quobyte [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=85842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:04:11 devstack cinder-volume[85842]: DEBUG cinder.volume.drivers.quobyte [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=85842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:04:11 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:04:11 devstack cinder-volume[85842]: DEBUG oslo_concurrency.processutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=85842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:11 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:04:11 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:12 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:12 devstack cinder-volume[85842]: DEBUG oslo_concurrency.processutils [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.707s {{(pid=85842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:12 devstack cinder-volume[85842]: INFO cinder.volume.manager [None req-69234bc6-2aed-45c4-a1f0-154d9d9c1562 None None] Driver post RPC initialization completed successfully. Jul 03 01:04:15 devstack cinder-volume[85627]: INFO oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Caught SIGTERM, stopping children Jul 03 01:04:15 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Acquiring lock "singleton_lock" {{(pid=85627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 01:04:15 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Acquired lock "singleton_lock" {{(pid=85627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 01:04:15 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Releasing lock "singleton_lock" {{(pid=85627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 01:04:15 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Stop services. {{(pid=85627) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 01:04:15 devstack cinder-volume[85627]: DEBUG oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Killing children. {{(pid=85627) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 01:04:15 devstack cinder-volume[85627]: INFO oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Waiting on 1 children to exit Jul 03 01:04:15 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Acquiring lock "singleton_lock" {{(pid=85842) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 01:04:15 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Acquired lock "singleton_lock" {{(pid=85842) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 01:04:15 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Releasing lock "singleton_lock" {{(pid=85842) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 01:04:15 devstack cinder-volume[85842]: WARNING amqp [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 01:04:15 devstack cinder-volume[85842]: WARNING amqp [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 01:04:15 devstack cinder-volume[85627]: INFO oslo_service.backend._eventlet.service [None req-58d5d5e0-13ea-4460-b722-56a7d4ce0d51 None None] Child 85842 exited with status 0 Jul 03 01:04:16 devstack cinder-volume[86114]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 01:04:16 devstack cinder-volume[86114]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 01:04:16 devstack cinder-volume[86114]: we strongly recommend against using it for new projects. Jul 03 01:04:16 devstack cinder-volume[86114]: If you are already using Eventlet, we recommend migrating to a different Jul 03 01:04:16 devstack cinder-volume[86114]: framework. For more detail see Jul 03 01:04:16 devstack cinder-volume[86114]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 01:04:16 devstack cinder-volume[86114]: import eventlet # noqa Jul 03 01:04:18 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 01:04:18 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 01:04:18 devstack cinder-volume[86114]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 01:04:19 devstack cinder-volume[86114]: INFO dbcounter [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] Registered counter for database cinder Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_db.sqlalchemy.engines [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86114) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG dbcounter [-] [86114] Writer thread running {{(pid=86114) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 01:04:20 devstack cinder-volume[86114]: INFO cinder.rpc [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 01:04:20 devstack cinder-volume[86114]: INFO cinder.rpc [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_db.sqlalchemy.engines [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86114) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:04:20 devstack cinder-volume[86114]: INFO cinder.volume.manager [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] Determined volume DB was empty at startup. Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG cinder.volume.manager [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86114) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 01:04:20 devstack cinder-volume[86114]: WARNING stevedore.named [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 01:04:20 devstack cinder-volume[86114]: WARNING castellan.key_manager [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 01:04:20 devstack cinder-volume[86114]: WARNING cinder.keymgr.conf_key_mgr [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 01:04:20 devstack cinder-volume[86114]: INFO cinder.volume.manager [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_db.sqlalchemy.engines [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86114) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:04:20 devstack cinder-volume[86114]: INFO oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] Starting 1 workers Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] Started child 86357 {{(pid=86114) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] Full set of CONF: {{(pid=86114) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] ******************************************************************************** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] Configuration options gathered from: {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] ================================================================================ {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] allow_availability_zone_fallback = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86357]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] allow_compression_on_image_upload = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] allowed_direct_url_schemes = [] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] api_rate_limit = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] auth_strategy = keystone {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_availability_zone = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_host = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_name = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_stats_polling_interval = 60 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backup_api_class = cinder.backup.api.API {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backup_name_template = backup-%s {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backup_use_same_host = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backup_use_temp_snapshot = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] chap_password = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] chap_username = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cinder_internal_tenant_project_id = 7aa2df5985d647cc8a3df3ad688737f3 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cinder_internal_tenant_user_id = ce31013399f347b1a8ed64afa54284a5 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cluster = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] compression_format = gzip {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] compute_api_class = cinder.compute.nova.API {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] config_dir = [] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] config_source = [] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] control_exchange = openstack {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] debug = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] default_availability_zone = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] default_group_type = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] default_volume_type = QuobyteHD {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] disk_geometry = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] driver_client_cert = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] driver_client_cert_key = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] driver_data_namespace = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] driver_ssl_cert_path = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] driver_ssl_cert_verify = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] driver_use_ssl = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] enable_new_services = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] enable_unsupported_driver = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] enabled_backends = ['QuobyteHD'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] enforce_multipath_for_image_xfer = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] filter_function = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance_api_insecure = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance_api_servers = ['http://192.168.122.24/image'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance_api_ssl_compression = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance_ca_certificates_file = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance_catalog_info = image:glance:publicURL {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance_certfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance_keyfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance_num_retries = 3 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance_request_timeout = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] goodness_function = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] graceful_shutdown_timeout = 5 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] group_api_class = cinder.group.api.API {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] host = devstack {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] image_compress_on_upload = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] image_conversion_address_space_limit = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] image_conversion_cpu_limit = 60 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] image_conversion_disable = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] image_upload_use_cinder_backend = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] image_upload_use_internal_tenant = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] image_volume_cache_enabled = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] image_volume_cache_max_count = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] image_volume_cache_max_size_gb = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] init_host_max_objects_retrieval = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] instance_format = [instance: %(uuid)s] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] iscsi_target_flags = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] iscsi_write_cache = on {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] iser_helper = tgtadm {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] iser_ip_address = 192.168.122.24 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] iser_port = 3260 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] log_color = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] log_config_append = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] log_dir = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] log_file = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] log_options = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] log_rotate_interval = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] log_rotate_interval_type = days {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] log_rotation_type = none {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] max_age = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] max_logfile_count = 30 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] max_logfile_size_mb = 200 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] max_over_subscription_ratio = 20.0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] message_reap_interval = 86400 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] message_ttl = 2592000 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] migration_create_volume_timeout_secs = 300 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] monkey_patch = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] monkey_patch_modules = [] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] my_ip = 192.168.122.24 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] no_snapshot_gb_quota = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] num_iser_scan_tries = 3 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] num_shell_tries = 3 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] num_volume_device_scan_tries = 3 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] nvmeof_conn_info_version = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] nvmet_ns_id = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] nvmet_port_id = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] osapi_max_limit = 1000 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] osapi_volume_ext_list = [] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] osapi_volume_listen_port = 8776 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] osapi_volume_use_ssl = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 01:04:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86357) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] osapi_volume_workers = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] per_volume_size_limit = -1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] periodic_fuzzy_delay = 60 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] periodic_interval = 60 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] public_endpoint = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] publish_errors = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] quota_backup_gigabytes = 1000 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] quota_backups = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] quota_gigabytes = 1000 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] quota_groups = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] quota_snapshots = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] quota_volumes = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] rate_limit_burst = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] rate_limit_except_level = CRITICAL {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] rate_limit_interval = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] reinit_driver_count = 3 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] replication_device = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] report_discard_supported = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] report_interval = 120 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] reservation_clean_interval = 86400 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] reservation_expire = 86400 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] reserved_image_namespaces = [] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] reserved_percentage = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] rpc_response_timeout = 120 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] run_external_periodic_tasks = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] scst_target_driver = iscsi {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] scst_target_iqn_name = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] service_down_time = 720 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] shell_completion = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] snapshot_name_template = snapshot-%s {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] split_loggers = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] state_path = /opt/stack/data/cinder {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] storage_availability_zone = nova {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] storage_protocol = iSCSI {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] syslog_log_facility = LOG_USER {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] target_helper = lioadm {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] target_ip_address = 192.168.122.24 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] target_port = 3260 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] target_protocol = iscsi {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] target_secondary_ip_addresses = [] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] trace_flags = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] transport_url = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] until_refresh = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] use_chap_auth = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] use_default_quota_class = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] use_journal = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] use_json = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] use_multipath_for_image_xfer = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] use_stderr = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] use_syslog = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] verify_glance_signatures = enabled {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] volume_api_class = cinder.volume.api.API {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] volume_backend_name = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] volume_clear = zero {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] volume_clear_ionice = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] volume_clear_size = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] volume_copy_bps_limit = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] volume_dd_blocksize = 1M {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] volume_name_template = volume-%s {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] volume_service_inithost_offload = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] volume_usage_audit_period = month {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] zoning_mode = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_concurrency.disable_process_locking = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.auth_section = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.auth_type = password {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.auth_version = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.cache = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.certfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.include_service_catalog = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86357) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 01:04:20 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.quobyte [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 01:04:20 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.quobyte [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.insecure = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.interface = public {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.keyfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Running cmd (subprocess): mount.quobyte {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_password = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcache_username = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.region_name = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.service_type = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.backend = dogpile.cache.null {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.backend_argument = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.backend_expiration_time = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.config_prefix = cache.oslo {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.debug_cache_backend = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.enable_retry_client = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.enable_socket_keepalive = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.enabled = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.expiration_time = 600 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.hashclient_retry_attempts = 2 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.memcache_dead_retry = 300 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.memcache_pool_maxsize = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.memcache_sasl_enabled = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.password = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.proxies = [] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.redis_db = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.redis_server = localhost:6379 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.retry_attempts = 2 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.retry_delay = 0.0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.socket_keepalive_count = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.socket_keepalive_idle = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.socket_keepalive_interval = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.socket_timeout = 1.0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.tls_allowed_ciphers = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.tls_cafile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.tls_certfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.tls_enabled = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.tls_keyfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cache.username = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] coordination.backend_url = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.asyncio_connection = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.asyncio_slave_connection = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.backend = sqlalchemy {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.connection = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.connection_debug = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.connection_parameters = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.connection_recycle_time = 3600 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.connection_trace = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.db_inc_retry_interval = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.db_max_retries = 20 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:20 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.db_max_retry_interval = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.db_retry_interval = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.max_overflow = 50 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.max_pool_size = 5 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.max_retries = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.mysql_wsrep_sync_wait = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.pool_timeout = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.retry_interval = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack quobyte-client[86361]: Reading configuration file: /etc/quobyte/client.cfg Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.slave_connection = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack quobyte-client[86361]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.sqlite_synchronous = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.synchronous_reader = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] database.use_db_reconnect = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler.connection_string = messaging:// {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler.enabled = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler.es_doc_type = notification {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler.es_scroll_size = 10000 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler.es_scroll_time = 2m {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler.filter_error_trace = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler.hmac_keys = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler.sentinel_service_name = mymaster {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler.socket_timeout = 0.1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler.trace_requests = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler.trace_sqlalchemy = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler_jaeger.process_tags = {} {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler_jaeger.service_name_prefix = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] profiler_otlp.service_name_prefix = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] CMD "mount.quobyte" returned: 1 in 0.078s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_policy.enforce_new_defaults = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_policy.enforce_scope = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_policy.policy_default_rule = default {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:04:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:04:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_policy.policy_file = policy.yaml {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] privsep_osbrick.group = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] privsep_osbrick.helper_command = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] privsep_osbrick.user = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:04:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:04:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cinder_sys_admin.group = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cinder_sys_admin.helper_command = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] cinder_sys_admin.user = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] service_user.auth_section = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] service_user.auth_type = password {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] service_user.cafile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] service_user.certfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] service_user.collect_timing = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] service_user.insecure = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] service_user.keyfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] service_user.send_service_user_token = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] service_user.split_loggers = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] service_user.timeout = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance.auth_section = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance.auth_type = password {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance.certfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance.collect_timing = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance.insecure = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance.keyfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance.region_name = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance.split_loggers = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] glance.timeout = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.backend_availability_zone = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.chap_password = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.chap_username = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.disk_geometry = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.driver_client_cert = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.driver_client_cert_key = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack sudo[86365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:04:21 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.driver_data_namespace = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.driver_use_ssl = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.extra_capabilities = {} {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.filter_function = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.goodness_function = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.iscsi_target_flags = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.iscsi_write_cache = on {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.iser_helper = tgtadm {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.iser_port = 3260 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.nas_host = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.nas_login = admin {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.nas_mount_options = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.nas_password = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.nas_private_key = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.nas_share_path = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.num_shell_tries = 3 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.quobyte_volume_url = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.replication_device = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.report_discard_supported = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.reserved_percentage = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.target_helper = tgtadm {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.target_port = 3260 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.target_protocol = iscsi {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.trace_flags = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.unique_fqdn_network = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.use_chap_auth = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.volume_backend_name = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.volume_clear = zero {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.volume_clear_ionice = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.volume_clear_size = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_reports.file_event_handler = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_reports.log_dir = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.backend_availability_zone = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.backend_host = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.chap_password = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.chap_username = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.chiscsi_conf = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.disk_geometry = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.driver_client_cert = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.driver_data_namespace = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.driver_use_ssl = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.extra_capabilities = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.filter_function = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.goodness_function = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.iser_helper = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.iser_ip_address = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.iser_port = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.iser_target_prefix = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.nas_host = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.nas_login = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.nas_mount_options = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.nas_password = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.nas_private_key = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.nas_share_path = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.nas_ssh_port = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.num_shell_tries = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.nvmet_port_id = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.replication_device = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.report_discard_supported = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.reserved_percentage = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.scst_target_driver = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.storage_protocol = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.target_helper = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.target_ip_address = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.target_port = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.target_prefix = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.target_protocol = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.trace_flags = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.use_chap_auth = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.volume_clear = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.volume_clear_size = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] QuobyteHD.volumes_dir = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.ssl = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_notifications.driver = [] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_notifications.retry = -1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] key_manager.fixed_key = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.barbican_api_version = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.barbican_endpoint = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.barbican_endpoint_type = public {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.barbican_region_name = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.cafile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.certfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.collect_timing = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.insecure = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.keyfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.number_of_retries = 60 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.retry_delay = 1 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.send_service_user_token = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.split_loggers = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.timeout = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.verify_ssl = True {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican.verify_ssl_path = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican_service_user.auth_section = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican_service_user.auth_type = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican_service_user.cafile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican_service_user.certfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican_service_user.collect_timing = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican_service_user.insecure = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican_service_user.keyfile = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican_service_user.split_loggers = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] barbican_service_user.timeout = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] vault.approle_role_id = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] vault.approle_secret_id = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] vault.kv_mountpoint = secret {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] vault.kv_path = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] vault.kv_version = 2 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] vault.namespace = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] vault.root_token_id = **** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] vault.ssl_ca_crt_file = None {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] vault.timeout = 60.0 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] vault.use_ssl = False {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:04:21 devstack cinder-volume[86114]: DEBUG oslo_service.backend._eventlet.service [None req-df76a4dc-9796-4282-8428-d77bb47145e2 None None] ******************************************************************************** {{(pid=86114) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 01:04:22 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.030s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:22 devstack cinder-volume[86357]: INFO cinder.volume.driver [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Driver hasn't implemented _init_vendor_properties() Jul 03 01:04:22 devstack cinder-volume[86357]: DEBUG cinder.volume.driver [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545623779297, 'free_capacity_gb': 1775.7545623779297, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86357) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 01:04:22 devstack cinder-volume[86357]: DEBUG oslo_db.sqlalchemy.engines [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86357) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:04:22 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writer thread running {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 01:04:22 devstack cinder-volume[86357]: DEBUG cinder.db.api [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Building query based on filter {{(pid=86357) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 03 01:04:22 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86357) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 01:04:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:04:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:04:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:04:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:04:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:04:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:22 devstack cinder-volume[86357]: INFO cinder.keymgr.migration [None req-29359ce7-a00d-41c5-8d58-fc8579f478e2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 01:04:22 devstack sudo[86391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:04:22 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:23 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.798s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:23 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:04:23 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Driver initialization completed successfully. Jul 03 01:04:23 devstack cinder-volume[86357]: INFO cinder.manager [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Initiating service 3 cleanup Jul 03 01:04:23 devstack cinder-volume[86357]: INFO cinder.manager [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Service 3 cleanup completed. Jul 03 01:04:23 devstack cinder-volume[86357]: DEBUG cinder.service [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Creating RPC server for service cinder-volume {{(pid=86357) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 01:04:23 devstack cinder-volume[86357]: DEBUG cinder.service [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86357) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 01:04:23 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 01:04:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:04:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:04:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:04:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:04:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:04:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:23 devstack sudo[86410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:04:23 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:23 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.612s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:23 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-707dfc57-68c5-4f79-aab3-02d69b0baf3e None None] Driver post RPC initialization completed successfully. Jul 03 01:04:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:04:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 6 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:04:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:04:30 devstack cinder-volume[86114]: DEBUG dbcounter [-] [86114] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86114) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:04:33 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:04:33 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=3 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Flow 'volume_create_manager' (41dfb783-2969-421d-aa0a-be17f5266e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1522101-1350-4f41-9674-07bb58263e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1522101-1350-4f41-9674-07bb58263e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1522157866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab32e952-fcf9-4522-abc8-52a5ae26b356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d713a069234046868755605e136c0340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:05:22Z,use_quota=True,user_id='9d7e60fe1bad4c88879396a7c6e46eea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a3c51b-d889-4f72-937e-af794ac58378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a3c51b-d889-4f72-937e-af794ac58378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8abb74a-fa5b-4794-b768-4d69d9b8780e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8abb74a-fa5b-4794-b768-4d69d9b8780e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab32e952-fcf9-4522-abc8-52a5ae26b356', 'volume_name': 'volume-ab32e952-fcf9-4522-abc8-52a5ae26b356', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785609b1-6eb2-4fe0-bad1-f4ed0a1bc42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785609b1-6eb2-4fe0-bad1-f4ed0a1bc42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53a9188-5f02-4bb1-8e80-8ba3f8a0af33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:21 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Volume ab32e952-fcf9-4522-abc8-52a5ae26b356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab32e952-fcf9-4522-abc8-52a5ae26b356', 'volume_size': 1} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1522157866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab32e952-fcf9-4522-abc8-52a5ae26b356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d713a069234046868755605e136c0340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:05:22Z,use_quota=True,user_id='9d7e60fe1bad4c88879396a7c6e46eea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Creating volume ab32e952-fcf9-4522-abc8-52a5ae26b356 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:05:21 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:05:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:21 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356 1073741824 Jul 03 01:05:21 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:22 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356 1073741824" returned: 0 in 1.140s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:23 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356 Jul 03 01:05:23 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:23 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356" returned: 0 in 0.837s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:05:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53a9188-5f02-4bb1-8e80-8ba3f8a0af33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab32e952-fcf9-4522-abc8-52a5ae26b356', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c772ec0-e519-43b7-bc3f-0547de5fd765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:23 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Volume volume-ab32e952-fcf9-4522-abc8-52a5ae26b356 (ab32e952-fcf9-4522-abc8-52a5ae26b356): created successfully Jul 03 01:05:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c772ec0-e519-43b7-bc3f-0547de5fd765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Flow 'volume_create_manager' (41dfb783-2969-421d-aa0a-be17f5266e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:05:23 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9a87a60b-1a0c-48ff-85b2-f8fc4976a8d6 tempest-TaggedAttachmentsTest-1279123031 None] Created volume successfully. Jul 03 01:05:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:05:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:05:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:05:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:27 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:05:27 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:28 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.970s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:05:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:05:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 6 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:05:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:05:33 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:05:33 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Flow 'volume_create_manager' (67716c28-aad1-4536-932b-7f5c9b7100c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b6b551-3c5d-4eca-b59a-a4f1f9d29b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b6b551-3c5d-4eca-b59a-a4f1f9d29b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1459544939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab10312-9725-4803-b185-dd3fa693e4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cccce3193914117b91c42af35ea97ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:05:58Z,use_quota=True,user_id='978c501ff6d441a98df30297250e438f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c7baa0-1568-4d58-92e8-6846f3f508eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c7baa0-1568-4d58-92e8-6846f3f508eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7035ed84-b6fc-413c-9bfe-5bf2d5062aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7035ed84-b6fc-413c-9bfe-5bf2d5062aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab10312-9725-4803-b185-dd3fa693e4fc', 'volume_name': 'volume-1ab10312-9725-4803-b185-dd3fa693e4fc', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab29627-9522-4c05-a6ed-0d55e6845b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab29627-9522-4c05-a6ed-0d55e6845b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9002a526-aa12-40c2-94e9-309fae0a60af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:58 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Volume 1ab10312-9725-4803-b185-dd3fa693e4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab10312-9725-4803-b185-dd3fa693e4fc', 'volume_size': 1} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1459544939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab10312-9725-4803-b185-dd3fa693e4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cccce3193914117b91c42af35ea97ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:05:58Z,use_quota=True,user_id='978c501ff6d441a98df30297250e438f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Creating volume 1ab10312-9725-4803-b185-dd3fa693e4fc {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:05:58 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:05:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1ab10312-9725-4803-b185-dd3fa693e4fc 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:58 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1ab10312-9725-4803-b185-dd3fa693e4fc 1073741824 Jul 03 01:05:58 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:00 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1ab10312-9725-4803-b185-dd3fa693e4fc 1073741824" returned: 0 in 2.222s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1ab10312-9725-4803-b185-dd3fa693e4fc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:01 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1ab10312-9725-4803-b185-dd3fa693e4fc Jul 03 01:06:01 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:01 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1ab10312-9725-4803-b185-dd3fa693e4fc" returned: 0 in 1.004s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] <== create_volume: return (3306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:06:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.313s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9002a526-aa12-40c2-94e9-309fae0a60af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab10312-9725-4803-b185-dd3fa693e4fc', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4a221e-fa57-4a01-9e27-ab681aa3530d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:02 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Volume volume-1ab10312-9725-4803-b185-dd3fa693e4fc (1ab10312-9725-4803-b185-dd3fa693e4fc): created successfully Jul 03 01:06:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4a221e-fa57-4a01-9e27-ab681aa3530d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Flow 'volume_create_manager' (67716c28-aad1-4536-932b-7f5c9b7100c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:02 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ddb1fa0c-4e6e-401f-82de-3bfb675d6165 tempest-VolumesAdminNegativeTest-494192798 None] Created volume successfully. Jul 03 01:06:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Acquiring lock "cinder-1ab10312-9725-4803-b185-dd3fa693e4fc-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:06:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Lock "cinder-1ab10312-9725-4803-b185-dd3fa693e4fc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:06:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Acquiring lock "cinder-quobyte-1ab10312-9725-4803-b185-dd3fa693e4fc" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:06:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Lock "cinder-quobyte-1ab10312-9725-4803-b185-dd3fa693e4fc" acquired by "delete_volume" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:06:04 devstack cinder-volume[86357]: INFO oslo.privsep.daemon [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgwjpr4tq/privsep.sock'] Jul 03 01:06:04 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgwjpr4tq/privsep.sock Jul 03 01:06:04 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:05 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 03 01:06:05 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 01:06:05 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 01:06:05 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 01:06:05 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 01:06:05 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 01:06:05 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 01:06:05 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 01:06:05 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 03 01:06:06 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 03 01:06:06 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 01:06:06 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 01:06:06 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 01:06:06 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 01:06:06 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 01:06:06 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 01:06:06 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 01:06:06 devstack cinder-volume[86357]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 03 01:06:07 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:07 devstack cinder-volume[86357]: INFO oslo.privsep.daemon [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Spawned new privsep daemon via rootwrap Jul 03 01:06:07 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Accepted privsep connection to /tmp/tmpgwjpr4tq/privsep.sock {{(pid=86357) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 03 01:06:07 devstack cinder-volume[86357]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 03 01:06:07 devstack cinder-volume[86357]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 03 01:06:07 devstack cinder-volume[86357]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 03 01:06:07 devstack cinder-volume[86357]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87627 Jul 03 01:06:07 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3f4e16-8ff9-4bb8-8d17-dff9450ea564]: (2,) {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:07 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[189d56fe-87a8-436b-addf-e4b170660cce]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1ab10312-9725-4803-b185-dd3fa693e4fc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:07 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1ab10312-9725-4803-b185-dd3fa693e4fc Jul 03 01:06:07 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:08 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1ab10312-9725-4803-b185-dd3fa693e4fc" returned: 0 in 1.269s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1ab10312-9725-4803-b185-dd3fa693e4fc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:08 devstack sudo[87636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1ab10312-9725-4803-b185-dd3fa693e4fc Jul 03 01:06:08 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:09 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1ab10312-9725-4803-b185-dd3fa693e4fc" returned: 0 in 0.870s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:09 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Lock "cinder-quobyte-1ab10312-9725-4803-b185-dd3fa693e4fc" released by "delete_volume" :: held 5.060s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:06:09 devstack cinder-volume[86357]: WARNING cinder.quota [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:06:09 devstack cinder-volume[86357]: WARNING cinder.quota [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:06:09 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Created reservations ['6eb54d52-0c94-41bf-aba9-cbfaa97507e9', 'c8aebeb7-52c0-4e02-a3a5-0aac045c22cc', '01d4687c-f07d-4f41-9d7f-691b8073697f', 'ab2a6730-a352-4d49-aca2-4c265ff48919'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:06:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:09 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:06:09 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:11 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.889s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:11 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:06:11 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Deleted volume successfully. Jul 03 01:06:11 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d75a5843-84c5-43e5-8564-83f262147b47 tempest-VolumesAdminNegativeTest-494192798 None] Lock "cinder-1ab10312-9725-4803-b185-dd3fa693e4fc-delete_volume" released by "delete_volume" :: held 7.627s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Flow 'volume_create_manager' (341d9b6f-f579-4ee4-bc21-4b65027f8e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642bc9dd-ca8e-4e8c-84a4-d5b849378253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642bc9dd-ca8e-4e8c-84a4-d5b849378253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-338048964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fea8f14-42bb-4fa0-a409-101d37de844d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58fd75c007f444fb5fe167fa7668523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:14Z,use_quota=True,user_id='57584f1140ae430888634d9aaa16372a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078b371d-c2e6-4c65-b545-5f9b69cfe113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078b371d-c2e6-4c65-b545-5f9b69cfe113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e3a3d0-9e66-4544-9521-d07a8c71d82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e3a3d0-9e66-4544-9521-d07a8c71d82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fea8f14-42bb-4fa0-a409-101d37de844d', 'volume_name': 'volume-2fea8f14-42bb-4fa0-a409-101d37de844d', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa274fd-54aa-47e7-a231-2adab371ba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa274fd-54aa-47e7-a231-2adab371ba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a28ce7-9f14-4af5-adf7-ceec2265c1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:14 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Volume 2fea8f14-42bb-4fa0-a409-101d37de844d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fea8f14-42bb-4fa0-a409-101d37de844d', 'volume_size': 1} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-338048964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fea8f14-42bb-4fa0-a409-101d37de844d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58fd75c007f444fb5fe167fa7668523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:14Z,use_quota=True,user_id='57584f1140ae430888634d9aaa16372a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Creating volume 2fea8f14-42bb-4fa0-a409-101d37de844d {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:06:14 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:06:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:14 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d 1073741824 Jul 03 01:06:14 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:15 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d 1073741824" returned: 0 in 1.255s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:15 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d Jul 03 01:06:15 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:16 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d" returned: 0 in 0.966s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] <== create_volume: return (2300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:06:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.307s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a28ce7-9f14-4af5-adf7-ceec2265c1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fea8f14-42bb-4fa0-a409-101d37de844d', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f74430c-9bc9-4107-9383-8960cf2a2cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:16 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Volume volume-2fea8f14-42bb-4fa0-a409-101d37de844d (2fea8f14-42bb-4fa0-a409-101d37de844d): created successfully Jul 03 01:06:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f74430c-9bc9-4107-9383-8960cf2a2cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Flow 'volume_create_manager' (341d9b6f-f579-4ee4-bc21-4b65027f8e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b11d8afe-df44-4917-982c-c0b11e44a3de tempest-ServerActionsTestOtherA-46629136 None] Created volume successfully. Jul 03 01:06:26 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=8,cinder:UPDATE=15,cinder:DELETE=3,cinder:INSERT=2 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:06:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:06:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:27 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:06:27 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:28 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.804s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:06:33 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=14,cinder:SELECT=11,cinder:INSERT=4 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:06:49 devstack cinder-volume[86357]: WARNING py.warnings [req-7eb152ae-9887-4bfb-bebd-3ecdf7f93f7f req-6cc36902-3e21-4582-8cdb-d67b67b94008 tempest-TaggedAttachmentsTest-1279123031 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 03 01:06:49 devstack cinder-volume[86357]: .first() Jul 03 01:06:49 devstack cinder-volume[86357]: Jul 03 01:06:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-7eb152ae-9887-4bfb-bebd-3ecdf7f93f7f req-6cc36902-3e21-4582-8cdb-d67b67b94008 tempest-TaggedAttachmentsTest-1279123031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-7eb152ae-9887-4bfb-bebd-3ecdf7f93f7f req-6cc36902-3e21-4582-8cdb-d67b67b94008 tempest-TaggedAttachmentsTest-1279123031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:49 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[41da4c6b-84a0-4a89-9585-baacaa6e91b5]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-7eb152ae-9887-4bfb-bebd-3ecdf7f93f7f req-6cc36902-3e21-4582-8cdb-d67b67b94008 tempest-TaggedAttachmentsTest-1279123031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:49 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356 Jul 03 01:06:49 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:50 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-7eb152ae-9887-4bfb-bebd-3ecdf7f93f7f req-6cc36902-3e21-4582-8cdb-d67b67b94008 tempest-TaggedAttachmentsTest-1279123031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356" returned: 0 in 0.969s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-7eb152ae-9887-4bfb-bebd-3ecdf7f93f7f req-6cc36902-3e21-4582-8cdb-d67b67b94008 tempest-TaggedAttachmentsTest-1279123031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:50 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-7eb152ae-9887-4bfb-bebd-3ecdf7f93f7f req-6cc36902-3e21-4582-8cdb-d67b67b94008 tempest-TaggedAttachmentsTest-1279123031 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-ab32e952-fcf9-4522-abc8-52a5ae26b356', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7eef2d1-5e2b-450b-8e4d-16c6d8b2b941', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:06:50 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-7eb152ae-9887-4bfb-bebd-3ecdf7f93f7f req-6cc36902-3e21-4582-8cdb-d67b67b94008 tempest-TaggedAttachmentsTest-1279123031 None] attachment_update completed successfully. Jul 03 01:06:58 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-d6228d54-3331-4405-83cf-eb54f2935689 req-d3b01001-a0ea-460f-9a66-4fcee380da70 tempest-TaggedAttachmentsTest-1279123031 None] Terminate volume connection completed successfully. Jul 03 01:06:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-d6228d54-3331-4405-83cf-eb54f2935689 req-d3b01001-a0ea-460f-9a66-4fcee380da70 tempest-TaggedAttachmentsTest-1279123031 None] Deleting attachment d7eef2d1-5e2b-450b-8e4d-16c6d8b2b941. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:07:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-66b38d70-8601-4444-8a44-11aadaeb77a3 req-3773ca35-348f-4aef-a5d7-885574b00af8 tempest-ServerActionsTestOtherA-46629136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-66b38d70-8601-4444-8a44-11aadaeb77a3 req-3773ca35-348f-4aef-a5d7-885574b00af8 tempest-ServerActionsTestOtherA-46629136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:06 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[061fa7c1-7591-421a-8e04-f8c03ba58870]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-66b38d70-8601-4444-8a44-11aadaeb77a3 req-3773ca35-348f-4aef-a5d7-885574b00af8 tempest-ServerActionsTestOtherA-46629136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:06 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d Jul 03 01:07:06 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Flow 'volume_create_manager' (094443ce-da47-4562-8a43-f368cf7956aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3362bba2-399f-4ddb-b5ec-1ee375cf41f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3362bba2-399f-4ddb-b5ec-1ee375cf41f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-830789956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d43c6e-2089-48e7-9fb7-10a1af6607d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae650ebabc04e35922bf644d2217ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:07Z,use_quota=True,user_id='0d94825c815149f8adf385a02f17658c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa21122e-019d-4a16-8b3d-fdadf158893a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa21122e-019d-4a16-8b3d-fdadf158893a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2898db5b-1225-45ca-834e-40fbdeb22ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2898db5b-1225-45ca-834e-40fbdeb22ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3d43c6e-2089-48e7-9fb7-10a1af6607d6', 'volume_name': 'volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38923b5d-124d-4f90-b79c-f6261b89d02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38923b5d-124d-4f90-b79c-f6261b89d02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1f3b18-032e-46cb-8d12-d49dac5d6179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:07 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Volume b3d43c6e-2089-48e7-9fb7-10a1af6607d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6', 'volume_size': 1} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:07 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-66b38d70-8601-4444-8a44-11aadaeb77a3 req-3773ca35-348f-4aef-a5d7-885574b00af8 tempest-ServerActionsTestOtherA-46629136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d" returned: 0 in 0.892s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-66b38d70-8601-4444-8a44-11aadaeb77a3 req-3773ca35-348f-4aef-a5d7-885574b00af8 tempest-ServerActionsTestOtherA-46629136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.923s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.207s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-830789956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d43c6e-2089-48e7-9fb7-10a1af6607d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae650ebabc04e35922bf644d2217ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:07Z,use_quota=True,user_id='0d94825c815149f8adf385a02f17658c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Creating volume b3d43c6e-2089-48e7-9fb7-10a1af6607d6 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:07:07 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:07 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6 1073741824 Jul 03 01:07:07 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-66b38d70-8601-4444-8a44-11aadaeb77a3 req-3773ca35-348f-4aef-a5d7-885574b00af8 tempest-ServerActionsTestOtherA-46629136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-2fea8f14-42bb-4fa0-a409-101d37de844d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06ae69ba-90e5-4ed1-837b-23117c2e877a', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:07:07 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-66b38d70-8601-4444-8a44-11aadaeb77a3 req-3773ca35-348f-4aef-a5d7-885574b00af8 tempest-ServerActionsTestOtherA-46629136 None] attachment_update completed successfully. Jul 03 01:07:08 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6 1073741824" returned: 0 in 0.929s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:08 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6 Jul 03 01:07:08 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:09 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6" returned: 0 in 1.047s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:07:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1f3b18-032e-46cb-8d12-d49dac5d6179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ee12c2-f85e-4e47-9bcf-888e6572be1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:09 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Volume volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6 (b3d43c6e-2089-48e7-9fb7-10a1af6607d6): created successfully Jul 03 01:07:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ee12c2-f85e-4e47-9bcf-888e6572be1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Flow 'volume_create_manager' (094443ce-da47-4562-8a43-f368cf7956aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:09 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c73555d2-a0a4-4e52-89c3-d8b777e55b00 tempest-AttachVolumeTestJSON-886997686 None] Created volume successfully. Jul 03 01:07:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-cda07fdb-fea3-4aad-ae7b-56d38a853fdf req-abc4b13c-4768-44a9-8a49-3b7f88ee2e80 tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-cda07fdb-fea3-4aad-ae7b-56d38a853fdf req-abc4b13c-4768-44a9-8a49-3b7f88ee2e80 tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:15 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0086cc72-f20a-41d3-acdf-e77e78c5546a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-cda07fdb-fea3-4aad-ae7b-56d38a853fdf req-abc4b13c-4768-44a9-8a49-3b7f88ee2e80 tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:15 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6 Jul 03 01:07:15 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Flow 'volume_create_manager' (f431ff7a-67da-4938-ab0c-21b14c8088fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328d2570-f621-4862-855a-ae2a7d66e479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328d2570-f621-4862-855a-ae2a7d66e479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-672410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4270655a4dad4ac3b1e227c2c9d4dced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:16Z,use_quota=True,user_id='4d6acc7ee8b341649b2ce0900a768a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f25450-e6f8-494f-acd8-7b171342d528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f25450-e6f8-494f-acd8-7b171342d528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c8257b-564e-4115-9536-1c4ec982ccf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c8257b-564e-4115-9536-1c4ec982ccf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3', 'volume_name': 'volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803fd319-b083-48cf-879d-b27fb40fd474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803fd319-b083-48cf-879d-b27fb40fd474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205ce664-6de4-4473-a325-af8ffce0043c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:16 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Volume 226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3', 'volume_size': 1} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:16 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-cda07fdb-fea3-4aad-ae7b-56d38a853fdf req-abc4b13c-4768-44a9-8a49-3b7f88ee2e80 tempest-AttachVolumeTestJSON-886997686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6" returned: 0 in 1.209s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-cda07fdb-fea3-4aad-ae7b-56d38a853fdf req-abc4b13c-4768-44a9-8a49-3b7f88ee2e80 tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.252s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.364s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-672410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4270655a4dad4ac3b1e227c2c9d4dced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:16Z,use_quota=True,user_id='4d6acc7ee8b341649b2ce0900a768a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Creating volume 226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:07:16 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:16 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3 1073741824 Jul 03 01:07:16 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-cda07fdb-fea3-4aad-ae7b-56d38a853fdf req-abc4b13c-4768-44a9-8a49-3b7f88ee2e80 tempest-AttachVolumeTestJSON-886997686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '841a6dfd-4585-4ce0-bb35-baf86bc62120', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:07:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-cda07fdb-fea3-4aad-ae7b-56d38a853fdf req-abc4b13c-4768-44a9-8a49-3b7f88ee2e80 tempest-AttachVolumeTestJSON-886997686 None] attachment_update completed successfully. Jul 03 01:07:17 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-dd2efc3c-cf9f-444e-970a-ae2c387159ee req-f1d43a17-a68e-46dd-8713-cdf062990491 tempest-ServerActionsTestOtherA-46629136 None] Terminate volume connection completed successfully. Jul 03 01:07:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-dd2efc3c-cf9f-444e-970a-ae2c387159ee req-f1d43a17-a68e-46dd-8713-cdf062990491 tempest-ServerActionsTestOtherA-46629136 None] Deleting attachment 06ae69ba-90e5-4ed1-837b-23117c2e877a. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:07:18 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3 1073741824" returned: 0 in 1.498s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:18 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3 Jul 03 01:07:18 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:19 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3" returned: 0 in 1.000s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] <== create_volume: return (2556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:07:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.562s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205ce664-6de4-4473-a325-af8ffce0043c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9897abf-6e64-4957-b735-869ce29f621f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:19 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Volume volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3 (226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3): created successfully Jul 03 01:07:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9897abf-6e64-4957-b735-869ce29f621f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Flow 'volume_create_manager' (f431ff7a-67da-4938-ab0c-21b14c8088fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:19 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a809e3c0-525a-4ec4-9ca9-be86a25d0fe4 tempest-DeleteServersTestJSON-948644662 None] Created volume successfully. Jul 03 01:07:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-dd2efc3c-cf9f-444e-970a-ae2c387159ee req-9f7c8448-a403-40b8-837a-90d3fa639c78 tempest-ServerActionsTestOtherA-46629136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-dd2efc3c-cf9f-444e-970a-ae2c387159ee req-9f7c8448-a403-40b8-837a-90d3fa639c78 tempest-ServerActionsTestOtherA-46629136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:20 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[003c0de6-49d6-4a7b-84fa-6833c867089d]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-dd2efc3c-cf9f-444e-970a-ae2c387159ee req-9f7c8448-a403-40b8-837a-90d3fa639c78 tempest-ServerActionsTestOtherA-46629136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:20 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d Jul 03 01:07:20 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Acquiring lock "cinder-ab32e952-fcf9-4522-abc8-52a5ae26b356-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Lock "cinder-ab32e952-fcf9-4522-abc8-52a5ae26b356-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Acquiring lock "cinder-quobyte-ab32e952-fcf9-4522-abc8-52a5ae26b356" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Lock "cinder-quobyte-ab32e952-fcf9-4522-abc8-52a5ae26b356" acquired by "delete_volume" :: waited 0.041s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:20 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcafda5-5b9a-4bb1-8713-75c2f352e0d6]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:20 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356 Jul 03 01:07:20 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:21 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-dd2efc3c-cf9f-444e-970a-ae2c387159ee req-9f7c8448-a403-40b8-837a-90d3fa639c78 tempest-ServerActionsTestOtherA-46629136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d" returned: 0 in 1.026s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-dd2efc3c-cf9f-444e-970a-ae2c387159ee req-9f7c8448-a403-40b8-837a-90d3fa639c78 tempest-ServerActionsTestOtherA-46629136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.048s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-dd2efc3c-cf9f-444e-970a-ae2c387159ee req-9f7c8448-a403-40b8-837a-90d3fa639c78 tempest-ServerActionsTestOtherA-46629136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-2fea8f14-42bb-4fa0-a409-101d37de844d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4f3916f-b8c9-4dc3-8960-b07dddf1db8e', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:07:21 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-dd2efc3c-cf9f-444e-970a-ae2c387159ee req-9f7c8448-a403-40b8-837a-90d3fa639c78 tempest-ServerActionsTestOtherA-46629136 None] attachment_update completed successfully. Jul 03 01:07:21 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356" returned: 0 in 0.877s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:21 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356 Jul 03 01:07:21 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:22 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ab32e952-fcf9-4522-abc8-52a5ae26b356" returned: 0 in 0.999s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Lock "cinder-quobyte-ab32e952-fcf9-4522-abc8-52a5ae26b356" released by "delete_volume" :: held 1.953s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:22 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Created reservations ['7756879b-c9a2-4297-a3c4-6fd639b49206', '82ef0905-6d50-49c3-b51c-4b7cf2792b55', 'a7ff67da-33f2-464d-aa19-2547194aefbc', '85f079e7-edfa-4d0e-80b1-b1816db5fd52'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:07:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:22 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:07:22 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-0ae175c2-e3a6-4891-ae84-600a97568f5d req-8f19464d-1a8b-4f89-b74c-87463818cc3a tempest-DeleteServersTestJSON-948644662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-0ae175c2-e3a6-4891-ae84-600a97568f5d req-8f19464d-1a8b-4f89-b74c-87463818cc3a tempest-DeleteServersTestJSON-948644662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:23 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[12867b8f-a913-4000-a3e6-7ee4453c0f37]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-0ae175c2-e3a6-4891-ae84-600a97568f5d req-8f19464d-1a8b-4f89-b74c-87463818cc3a tempest-DeleteServersTestJSON-948644662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:23 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3 Jul 03 01:07:23 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:24 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.552s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:24 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:07:24 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Deleted volume successfully. Jul 03 01:07:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-43e1959a-06f3-42c3-b01f-861054b3d293 tempest-TaggedAttachmentsTest-1279123031 None] Lock "cinder-ab32e952-fcf9-4522-abc8-52a5ae26b356-delete_volume" released by "delete_volume" :: held 3.837s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:25 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-0ae175c2-e3a6-4891-ae84-600a97568f5d req-8f19464d-1a8b-4f89-b74c-87463818cc3a tempest-DeleteServersTestJSON-948644662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3" returned: 0 in 1.968s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-0ae175c2-e3a6-4891-ae84-600a97568f5d req-8f19464d-1a8b-4f89-b74c-87463818cc3a tempest-DeleteServersTestJSON-948644662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-0ae175c2-e3a6-4891-ae84-600a97568f5d req-8f19464d-1a8b-4f89-b74c-87463818cc3a tempest-DeleteServersTestJSON-948644662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b5a49c0-a75b-4f1c-bcb3-67cd6c60a30e', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:07:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-0ae175c2-e3a6-4891-ae84-600a97568f5d req-8f19464d-1a8b-4f89-b74c-87463818cc3a tempest-DeleteServersTestJSON-948644662 None] attachment_update completed successfully. Jul 03 01:07:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:07:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:27 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:07:27 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:29 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.219s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:29 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:07:29 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:07:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 8 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:07:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:07:34 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-6e028c5e-ffc7-4c02-be6b-0e1c61ee7588 req-dde73620-4e9f-47a5-b2df-307cc6607b7e tempest-DeleteServersTestJSON-948644662 None] Terminate volume connection completed successfully. Jul 03 01:07:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-6e028c5e-ffc7-4c02-be6b-0e1c61ee7588 req-dde73620-4e9f-47a5-b2df-307cc6607b7e tempest-DeleteServersTestJSON-948644662 None] Deleting attachment 1b5a49c0-a75b-4f1c-bcb3-67cd6c60a30e. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:07:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Acquiring lock "cinder-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Lock "cinder-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Acquiring lock "cinder-quobyte-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Lock "cinder-quobyte-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3" acquired by "delete_volume" :: waited 0.039s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:39 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcac886-9e9b-4341-a5e0-3ddc76cb552b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:39 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3 Jul 03 01:07:39 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:41 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3" returned: 0 in 1.203s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:41 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3 Jul 03 01:07:41 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Flow 'volume_create_manager' (d7c1275f-3a06-45d3-9719-eb48644c186e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06c6f99-d9bd-4756-87ce-cbeaf74fc965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06c6f99-d9bd-4756-87ce-cbeaf74fc965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-172171504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b47d7d68-4c47-485e-aa69-2fb3196c9083,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1131da2c979c4510ab5acceab26b8e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:41Z,use_quota=True,user_id='90c94ea8592e4f0a8938c822fed4107d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b45d214-ef81-4d39-b79b-c5257c080cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b45d214-ef81-4d39-b79b-c5257c080cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a421b1-4d81-4e90-9b41-7384a07593c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a421b1-4d81-4e90-9b41-7384a07593c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b47d7d68-4c47-485e-aa69-2fb3196c9083', 'volume_name': 'volume-b47d7d68-4c47-485e-aa69-2fb3196c9083', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c90fb5-64af-4798-9aae-5bf5e7339a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c90fb5-64af-4798-9aae-5bf5e7339a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7867e6eb-19dd-4d47-85e6-8ce149faa974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:41 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Volume b47d7d68-4c47-485e-aa69-2fb3196c9083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b47d7d68-4c47-485e-aa69-2fb3196c9083', 'volume_size': 1} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-172171504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b47d7d68-4c47-485e-aa69-2fb3196c9083,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1131da2c979c4510ab5acceab26b8e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:41Z,use_quota=True,user_id='90c94ea8592e4f0a8938c822fed4107d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Creating volume b47d7d68-4c47-485e-aa69-2fb3196c9083 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:07:41 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:07:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b47d7d68-4c47-485e-aa69-2fb3196c9083 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:41 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b47d7d68-4c47-485e-aa69-2fb3196c9083 1073741824 Jul 03 01:07:41 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:42 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3" returned: 0 in 1.042s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Lock "cinder-quobyte-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3" released by "delete_volume" :: held 2.304s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:42 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Created reservations ['dcb03002-e692-47ad-9bbf-34029223a312', 'b34f2549-d417-468e-af08-56cd025a4712', 'e2a7bc37-8ff9-4c62-9d96-dea5ecdb0821', '0d5de944-137b-41d9-829f-f7a5d048038e'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:07:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:42 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:07:42 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:42 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b47d7d68-4c47-485e-aa69-2fb3196c9083 1073741824" returned: 0 in 1.084s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b47d7d68-4c47-485e-aa69-2fb3196c9083 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:42 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b47d7d68-4c47-485e-aa69-2fb3196c9083 Jul 03 01:07:42 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:43 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.781s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:43 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:07:43 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Deleted volume successfully. Jul 03 01:07:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e80077d0-c9ae-4ff5-a78a-716b4dfb6986 tempest-DeleteServersTestJSON-948644662 None] Lock "cinder-226e6ffd-a8f1-42fd-90e1-72f4e5e1d5e3-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:43 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b47d7d68-4c47-485e-aa69-2fb3196c9083" returned: 0 in 0.875s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:07:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7867e6eb-19dd-4d47-85e6-8ce149faa974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b47d7d68-4c47-485e-aa69-2fb3196c9083', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7285eaae-ac02-4107-b267-252385781f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:43 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Volume volume-b47d7d68-4c47-485e-aa69-2fb3196c9083 (b47d7d68-4c47-485e-aa69-2fb3196c9083): created successfully Jul 03 01:07:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7285eaae-ac02-4107-b267-252385781f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Flow 'volume_create_manager' (d7c1275f-3a06-45d3-9719-eb48644c186e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:43 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-cc542464-8c4b-4caf-a18e-544a75c759cd tempest-VolumesTestJSON-176202862 None] Created volume successfully. Jul 03 01:07:44 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=45,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=5 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:07:44 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:07:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Flow 'volume_create_manager' (ba8d80b7-d324-4503-b2bf-c956648db773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5926b157-499c-48fc-adc7-a90c65ffd5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5926b157-499c-48fc-adc7-a90c65ffd5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1023099697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07d507a-3426-4928-8cf6-9840f45f9e41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1131da2c979c4510ab5acceab26b8e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:45Z,use_quota=True,user_id='90c94ea8592e4f0a8938c822fed4107d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fcdd61-8631-4649-87b4-6c731990b303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fcdd61-8631-4649-87b4-6c731990b303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32d6667-4ed3-44a7-b1d8-a090b4ebd55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32d6667-4ed3-44a7-b1d8-a090b4ebd55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c07d507a-3426-4928-8cf6-9840f45f9e41', 'volume_name': 'volume-c07d507a-3426-4928-8cf6-9840f45f9e41', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0e80e0-4f3a-426e-99f6-88ec222200c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0e80e0-4f3a-426e-99f6-88ec222200c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8b81e1-ff76-4025-9f5e-feba216cd74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:45 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Volume c07d507a-3426-4928-8cf6-9840f45f9e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c07d507a-3426-4928-8cf6-9840f45f9e41', 'volume_size': 1} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1023099697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07d507a-3426-4928-8cf6-9840f45f9e41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1131da2c979c4510ab5acceab26b8e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:45Z,use_quota=True,user_id='90c94ea8592e4f0a8938c822fed4107d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Creating volume c07d507a-3426-4928-8cf6-9840f45f9e41 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:07:45 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:07:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c07d507a-3426-4928-8cf6-9840f45f9e41 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:45 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c07d507a-3426-4928-8cf6-9840f45f9e41 1073741824 Jul 03 01:07:45 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:46 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c07d507a-3426-4928-8cf6-9840f45f9e41 1073741824" returned: 0 in 0.961s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c07d507a-3426-4928-8cf6-9840f45f9e41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:46 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c07d507a-3426-4928-8cf6-9840f45f9e41 Jul 03 01:07:46 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:46 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c07d507a-3426-4928-8cf6-9840f45f9e41" returned: 0 in 0.842s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:07:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:46 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=52,cinder:UPDATE=36,cinder:INSERT=5 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:07:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8b81e1-ff76-4025-9f5e-feba216cd74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c07d507a-3426-4928-8cf6-9840f45f9e41', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18913d7c-9bc1-4a16-a012-73ce58746d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:46 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Volume volume-c07d507a-3426-4928-8cf6-9840f45f9e41 (c07d507a-3426-4928-8cf6-9840f45f9e41): created successfully Jul 03 01:07:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18913d7c-9bc1-4a16-a012-73ce58746d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Flow 'volume_create_manager' (ba8d80b7-d324-4503-b2bf-c956648db773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:47 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-dd0017ad-0497-443a-be94-07af937f1cea tempest-VolumesTestJSON-176202862 None] Created volume successfully. Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Flow 'volume_create_manager' (57969651-4c2c-48ce-9fd5-e4fe61939a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67bf5b2-bfa3-44a0-b48f-30c946806f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67bf5b2-bfa3-44a0-b48f-30c946806f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-712720776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c72990-7cf6-4b21-b2b9-ceddd15c56e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1131da2c979c4510ab5acceab26b8e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:49Z,use_quota=True,user_id='90c94ea8592e4f0a8938c822fed4107d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c7b36f-2e8b-485a-ae66-b32dfc9a671b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c7b36f-2e8b-485a-ae66-b32dfc9a671b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e4f709-34f7-4438-aa64-c3784eb23972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e4f709-34f7-4438-aa64-c3784eb23972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c72990-7cf6-4b21-b2b9-ceddd15c56e1', 'volume_name': 'volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14274ed2-c6aa-4002-8acb-2e92266eea82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14274ed2-c6aa-4002-8acb-2e92266eea82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e33c2f-af43-4374-b254-0a43ab045697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:48 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Volume d0c72990-7cf6-4b21-b2b9-ceddd15c56e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1', 'volume_size': 1} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-712720776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c72990-7cf6-4b21-b2b9-ceddd15c56e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1131da2c979c4510ab5acceab26b8e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:49Z,use_quota=True,user_id='90c94ea8592e4f0a8938c822fed4107d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Creating volume d0c72990-7cf6-4b21-b2b9-ceddd15c56e1 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:07:48 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:07:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:48 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1 1073741824 Jul 03 01:07:48 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:50 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1 1073741824" returned: 0 in 1.062s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:50 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1 Jul 03 01:07:50 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:51 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1" returned: 0 in 1.105s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] <== create_volume: return (2236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:07:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.238s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e33c2f-af43-4374-b254-0a43ab045697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e13b9a-9ea6-4f97-9d55-a25d689aa22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:51 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Volume volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1 (d0c72990-7cf6-4b21-b2b9-ceddd15c56e1): created successfully Jul 03 01:07:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e13b9a-9ea6-4f97-9d55-a25d689aa22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Flow 'volume_create_manager' (57969651-4c2c-48ce-9fd5-e4fe61939a5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:51 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7d92305b-7543-4674-831a-35e0f1899870 tempest-VolumesTestJSON-176202862 None] Created volume successfully. Jul 03 01:07:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Acquiring lock "cinder-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Lock "cinder-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Acquiring lock "cinder-quobyte-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Lock "cinder-quobyte-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1" acquired by "delete_volume" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:53 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[14561227-c376-4950-b6d8-44968aa3e909]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:53 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1 Jul 03 01:07:53 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:54 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1" returned: 0 in 0.831s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:54 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1 Jul 03 01:07:54 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:55 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1" returned: 0 in 0.808s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Lock "cinder-quobyte-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1" released by "delete_volume" :: held 1.685s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Created reservations ['0e241920-6564-4d58-9966-d82b98fb05fd', 'b1b9eaeb-2b86-48a1-98cc-426710bbf110', '2d6a5e99-7c0d-4824-933c-0568a2646053', 'd788cdd0-973f-4090-bbd1-90c4b0972957'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:55 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:07:55 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Acquiring lock "cinder-c07d507a-3426-4928-8cf6-9840f45f9e41-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Lock "cinder-c07d507a-3426-4928-8cf6-9840f45f9e41-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Acquiring lock "cinder-quobyte-c07d507a-3426-4928-8cf6-9840f45f9e41" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Lock "cinder-quobyte-c07d507a-3426-4928-8cf6-9840f45f9e41" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7af2b5f-468f-4968-b979-7b5630add874]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c07d507a-3426-4928-8cf6-9840f45f9e41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:56 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c07d507a-3426-4928-8cf6-9840f45f9e41 Jul 03 01:07:56 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:56 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-e4b51901-7262-4637-a7d8-660a88e238e6 req-6df1197c-9fb9-4d32-902d-64a8bbf28ce2 tempest-ServerActionsTestOtherA-46629136 None] Terminate volume connection completed successfully. Jul 03 01:07:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-e4b51901-7262-4637-a7d8-660a88e238e6 req-6df1197c-9fb9-4d32-902d-64a8bbf28ce2 tempest-ServerActionsTestOtherA-46629136 None] Deleting attachment f4f3916f-b8c9-4dc3-8960-b07dddf1db8e. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:07:56 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.940s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:56 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:07:56 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Deleted volume successfully. Jul 03 01:07:56 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4e177b03-d30c-4f9a-b8a7-9a0084f1c8eb tempest-VolumesTestJSON-176202862 None] Lock "cinder-d0c72990-7cf6-4b21-b2b9-ceddd15c56e1-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:56 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c07d507a-3426-4928-8cf6-9840f45f9e41" returned: 0 in 0.859s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c07d507a-3426-4928-8cf6-9840f45f9e41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:56 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c07d507a-3426-4928-8cf6-9840f45f9e41 Jul 03 01:07:56 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c07d507a-3426-4928-8cf6-9840f45f9e41" returned: 0 in 0.840s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:57 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Lock "cinder-quobyte-c07d507a-3426-4928-8cf6-9840f45f9e41" released by "delete_volume" :: held 1.757s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:57 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Created reservations ['831b3057-97e8-49d1-9069-2c078782777b', '72c3c697-4cd2-4064-93b8-a9bcf6fb4414', '3f00ed61-2813-426e-ba1d-e0c0f1f808d6', 'e7db6627-5517-4f6e-9889-388f9b654a84'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:07:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:57 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:07:57 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Acquiring lock "cinder-b47d7d68-4c47-485e-aa69-2fb3196c9083-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Lock "cinder-b47d7d68-4c47-485e-aa69-2fb3196c9083-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Acquiring lock "cinder-quobyte-b47d7d68-4c47-485e-aa69-2fb3196c9083" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Lock "cinder-quobyte-b47d7d68-4c47-485e-aa69-2fb3196c9083" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:58 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[8816ceaf-df23-4ffb-b0bf-180212116864]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b47d7d68-4c47-485e-aa69-2fb3196c9083 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:58 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b47d7d68-4c47-485e-aa69-2fb3196c9083 Jul 03 01:07:58 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:58 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.092s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:58 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:07:58 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Deleted volume successfully. Jul 03 01:07:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ed6a876-0cf0-40c6-9f31-02427c36bb63 tempest-VolumesTestJSON-176202862 None] Lock "cinder-c07d507a-3426-4928-8cf6-9840f45f9e41-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:59 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b47d7d68-4c47-485e-aa69-2fb3196c9083" returned: 0 in 1.000s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b47d7d68-4c47-485e-aa69-2fb3196c9083 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:59 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b47d7d68-4c47-485e-aa69-2fb3196c9083 Jul 03 01:07:59 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:00 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b47d7d68-4c47-485e-aa69-2fb3196c9083" returned: 0 in 1.120s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Lock "cinder-quobyte-b47d7d68-4c47-485e-aa69-2fb3196c9083" released by "delete_volume" :: held 2.190s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:00 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Created reservations ['ce7bcb1f-938f-4595-b931-74756d33c3e3', '6523201b-67d3-4998-ae60-b883fc7766bd', 'cbd03610-e00c-4a2e-b85b-284c03685866', '761dfb24-934c-4a0f-81b5-5da7d2f70b15'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:00 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:08:00 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:01 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.935s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:01 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:08:01 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Deleted volume successfully. Jul 03 01:08:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f99e984c-6b43-469a-b6c5-b385a47360cc tempest-VolumesTestJSON-176202862 None] Lock "cinder-b47d7d68-4c47-485e-aa69-2fb3196c9083-delete_volume" released by "delete_volume" :: held 3.460s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:02 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-3b65c7fa-f3d7-4a6d-9a2d-15aace5ccc5b req-ab624659-811f-438f-a79a-223f8a831acc tempest-AttachVolumeTestJSON-886997686 None] Terminate volume connection completed successfully. Jul 03 01:08:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-3b65c7fa-f3d7-4a6d-9a2d-15aace5ccc5b req-ab624659-811f-438f-a79a-223f8a831acc tempest-AttachVolumeTestJSON-886997686 None] Deleting attachment 841a6dfd-4585-4ce0-bb35-baf86bc62120. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:08:06 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-38c154cf-06dc-4c83-bef0-42e24e2954e7 tempest-GroupSnapshotsTest-620191198 None] Group tempest-GroupSnapshotsTest-Group-331164193: creating Jul 03 01:08:07 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-38c154cf-06dc-4c83-bef0-42e24e2954e7 tempest-GroupSnapshotsTest-620191198 None] Group tempest-GroupSnapshotsTest-Group-331164193: created successfully Jul 03 01:08:07 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-38c154cf-06dc-4c83-bef0-42e24e2954e7 tempest-GroupSnapshotsTest-620191198 None] Create group completed successfully. Jul 03 01:08:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Acquiring lock "cinder-2fea8f14-42bb-4fa0-a409-101d37de844d-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Lock "cinder-2fea8f14-42bb-4fa0-a409-101d37de844d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Acquiring lock "cinder-quobyte-2fea8f14-42bb-4fa0-a409-101d37de844d" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Lock "cinder-quobyte-2fea8f14-42bb-4fa0-a409-101d37de844d" acquired by "delete_volume" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:07 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[7140131c-4a13-4206-9f72-7eed419f27d9]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:07 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d Jul 03 01:08:07 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:08 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d" returned: 0 in 0.946s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:08 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d Jul 03 01:08:08 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Flow 'volume_create_manager' (ec9ae5eb-c2c6-44c3-859a-f7e52c8d47a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3f141e-7902-4447-a137-7a66cf5d7c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3f141e-7902-4447-a137-7a66cf5d7c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-126070629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c1855c7-fcc3-4ca4-9b36-03d03cdc5fee,host='devstack@QuobyteHD#QuobyteHD',id=c73841e6-c6e0-428e-9098-331eb0789176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1be8fab2703645f785faf079d7695abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:09Z,use_quota=True,user_id='321a6e6f2da0499d9324e3b8a50fa2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cbd739b-4853-429d-b009-de11a3656935),volume_type_id=8cbd739b-4853-429d-b009-de11a3656935)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fab9fe7-3a57-4617-80a9-20729e697aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fab9fe7-3a57-4617-80a9-20729e697aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a6a7a6-0c45-4ea5-a813-043ef55e4769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a6a7a6-0c45-4ea5-a813-043ef55e4769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73841e6-c6e0-428e-9098-331eb0789176', 'volume_name': 'volume-c73841e6-c6e0-428e-9098-331eb0789176', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d8c491-7e85-4de4-b0e6-1d8cd94f6796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d8c491-7e85-4de4-b0e6-1d8cd94f6796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb657752-e8fb-4868-8c81-a0c3683d6b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:08 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Volume c73841e6-c6e0-428e-9098-331eb0789176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73841e6-c6e0-428e-9098-331eb0789176', 'volume_size': 1} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2c1855c7-fcc3-4ca4-9b36-03d03cdc5fee,created_at=2026-07-02T23:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-126070629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c1855c7-fcc3-4ca4-9b36-03d03cdc5fee,host='devstack@QuobyteHD#QuobyteHD',id=c73841e6-c6e0-428e-9098-331eb0789176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1be8fab2703645f785faf079d7695abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:09Z,use_quota=True,user_id='321a6e6f2da0499d9324e3b8a50fa2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cbd739b-4853-429d-b009-de11a3656935),volume_type_id=8cbd739b-4853-429d-b009-de11a3656935)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Creating volume c73841e6-c6e0-428e-9098-331eb0789176 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:08:08 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:08:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:08 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 1073741824 Jul 03 01:08:08 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:09 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2fea8f14-42bb-4fa0-a409-101d37de844d" returned: 0 in 0.934s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:09 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Lock "cinder-quobyte-2fea8f14-42bb-4fa0-a409-101d37de844d" released by "delete_volume" :: held 1.932s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:09 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Created reservations ['d44055e9-3c32-4659-b84e-fe26163a92a5', 'b5ab87c2-982c-4047-be51-efcf96ad02f4', '9b31d777-3074-46f0-8f5b-c3a59a84d850', '9bdb8ae8-a033-440f-a4f2-c4f66f43ef5c'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:09 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:08:09 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:10 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 1073741824" returned: 0 in 1.471s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:10 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 Jul 03 01:08:10 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:10 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.081s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:10 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:08:10 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Deleted volume successfully. Jul 03 01:08:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3dc6c955-d864-4049-9fd3-8bc516e36970 tempest-ServerActionsTestOtherA-46629136 None] Lock "cinder-2fea8f14-42bb-4fa0-a409-101d37de844d-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:11 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176" returned: 0 in 0.964s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] <== create_volume: return (2530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:08:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.533s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb657752-e8fb-4868-8c81-a0c3683d6b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73841e6-c6e0-428e-9098-331eb0789176', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad746428-65d6-4b4f-93fc-25a2f2a0db3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:11 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Volume volume-c73841e6-c6e0-428e-9098-331eb0789176 (c73841e6-c6e0-428e-9098-331eb0789176): created successfully Jul 03 01:08:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad746428-65d6-4b4f-93fc-25a2f2a0db3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Flow 'volume_create_manager' (ec9ae5eb-c2c6-44c3-859a-f7e52c8d47a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:11 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-33136e50-7246-44e5-b8f2-3748c95e85d3 tempest-GroupSnapshotsTest-620191198 None] Created volume successfully. Jul 03 01:08:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] GroupSnapshot 3a175082-17d9-4ba8-9f68-cfd228ab9808: creating. Jul 03 01:08:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] Group snapshot 3a175082-17d9-4ba8-9f68-cfd228ab9808: creating. {{(pid=86357) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 01:08:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] Creating offline snapshot 42777791-c5b6-4fed-8923-3cc79002609c of volume c73841e6-c6e0-428e-9098-331eb0789176 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:08:13 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b286385-aadf-4421-82a0-9a899fc4e048]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:13 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 Jul 03 01:08:13 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:14 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176" returned: 0 in 1.038s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:14 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c 1G Jul 03 01:08:14 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:15 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c 1G" returned: 0 in 1.093s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73841e6-c6e0-428e-9098-331eb0789176 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:15 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73841e6-c6e0-428e-9098-331eb0789176 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c Jul 03 01:08:15 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:16 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73841e6-c6e0-428e-9098-331eb0789176 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c" returned: 0 in 0.750s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:16 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:08:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:16 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c Jul 03 01:08:16 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:17 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c" returned: 0 in 1.209s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:17 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.info Jul 03 01:08:17 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:19 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.info" returned: 0 in 2.181s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:19 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:08:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:19 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.info Jul 03 01:08:19 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:21 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.info" returned: 0 in 2.027s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.521s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:21 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-724235d0-c69b-4db4-86b2-d5efd7d30760 tempest-GroupSnapshotsTest-620191198 None] group_snapshot 3a175082-17d9-4ba8-9f68-cfd228ab9808: created successfully Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-42777791-c5b6-4fed-8923-3cc79002609c-7be01ead-2313-406b-889a-24297cac3889" by "_create_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-42777791-c5b6-4fed-8923-3cc79002609c-7be01ead-2313-406b-889a-24297cac3889" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Creating volume 7be01ead-2313-406b-889a-24297cac3889 from snapshot 42777791-c5b6-4fed-8923-3cc79002609c {{(pid=86357) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-7be01ead-2313-406b-889a-24297cac3889" by "_copy_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-7be01ead-2313-406b-889a-24297cac3889" acquired by "_copy_volume_from_snapshot" :: waited 0.062s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] snapshot: 42777791-c5b6-4fed-8923-3cc79002609c, volume: 7be01ead-2313-406b-889a-24297cac3889, {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[903045b5-5342-4560-995c-a27dc519214a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:24 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c Jul 03 01:08:24 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:26 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c" returned: 0 in 2.025s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c73841e6-c6e0-428e-9098-331eb0789176(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:08:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:08:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Creating direct copy from snapshot {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:08:26 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efbc4d1-ea13-4319-ba06-ce0409ff2d9b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:26 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 Jul 03 01:08:26 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:08:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:27 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176" returned: 0 in 1.413s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:27 devstack cinder-volume[86357]: DEBUG cinder.utils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Path /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889 not found in is_blk_device check {{(pid=86357) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:08:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:27 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:08:27 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:27 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889 Jul 03 01:08:27 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:30 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 2.353s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:30 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:08:30 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:08:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 8 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:08:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:08:34 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=34,cinder:UPDATE=40,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:08:34 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:INSERT=10,cinder:UPDATE=46,cinder:DELETE=5,cinder:SELECT=39 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:08:38 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889" returned: 0 in 11.108s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:38 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a75f50b-286e-4332-ac6e-985bb057d552]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:39 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 Jul 03 01:08:39 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:40 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176" returned: 0 in 1.490s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:40 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176, size 1024.00 MB, duration 11.11 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:08:40 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Converted 1024.00 MB image at 92.18 MB/s Jul 03 01:08:40 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:08:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:40 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889 Jul 03 01:08:40 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:41 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889" returned: 0 in 0.761s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-7be01ead-2313-406b-889a-24297cac3889" released by "_copy_volume_from_snapshot" :: held 17.066s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-42777791-c5b6-4fed-8923-3cc79002609c-7be01ead-2313-406b-889a-24297cac3889" released by "_create_volume_from_snapshot" :: held 17.175s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.230s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:41 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e80eb4d3-59bc-4016-ae05-f1f03d664f3b tempest-GroupSnapshotsTest-620191198 None] Create group from source-snapshot-3a175082-17d9-4ba8-9f68-cfd228ab9808 completed successfully. Jul 03 01:08:42 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:08:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Flow 'volume_create_manager' (54d9414b-7729-4b7b-8d32-e4d143b39dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353d7237-e405-422b-8a16-09b15411c6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353d7237-e405-422b-8a16-09b15411c6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1450700691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de39d3e5-c3ee-4163-bebc-72fb1b340985,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='173ab899039b485fa04b0b2b4beb6a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:43Z,use_quota=True,user_id='b15d84b0fe53403f84bb36c432dd7308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ccf338-76e1-45db-8c5e-f1ece69bfa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ccf338-76e1-45db-8c5e-f1ece69bfa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5d0e90-abd8-4ede-b7a3-71c7d777ecde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5d0e90-abd8-4ede-b7a3-71c7d777ecde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de39d3e5-c3ee-4163-bebc-72fb1b340985', 'volume_name': 'volume-de39d3e5-c3ee-4163-bebc-72fb1b340985', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91aa8e9f-8950-4fb7-b4dd-c1a5b53bb9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91aa8e9f-8950-4fb7-b4dd-c1a5b53bb9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca62cd2-1077-4725-ba79-b40769fec54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:43 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Volume de39d3e5-c3ee-4163-bebc-72fb1b340985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de39d3e5-c3ee-4163-bebc-72fb1b340985', 'volume_size': 1} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1450700691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de39d3e5-c3ee-4163-bebc-72fb1b340985,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='173ab899039b485fa04b0b2b4beb6a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:43Z,use_quota=True,user_id='b15d84b0fe53403f84bb36c432dd7308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Creating volume de39d3e5-c3ee-4163-bebc-72fb1b340985 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:08:43 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de39d3e5-c3ee-4163-bebc-72fb1b340985 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Flow 'volume_create_manager' (b36fe7ad-b6d7-476d-94e5-c3132c311ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:43 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de39d3e5-c3ee-4163-bebc-72fb1b340985 1073741824 Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5c9e95-7d28-4318-93d4-29084b701c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:43 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5c9e95-7d28-4318-93d4-29084b701c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-671360253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0bab6ff-149d-4f3b-8eae-97798b4f0188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42235ddcdb034f389ceb28cb6d00e86d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:43Z,use_quota=True,user_id='e6b05068f22c4e009f80006691300890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99cddf9d-8ac2-4cf1-8894-c70e554c8444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99cddf9d-8ac2-4cf1-8894-c70e554c8444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0f0199-aea0-40bd-aaf2-e5e2dc1d42c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0f0199-aea0-40bd-aaf2-e5e2dc1d42c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0bab6ff-149d-4f3b-8eae-97798b4f0188', 'volume_name': 'volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbe9be9-3424-4b7c-95e2-595a971a63e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbe9be9-3424-4b7c-95e2-595a971a63e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096dc4e4-7ceb-4132-ac0b-b07f8e263e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:43 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Volume d0bab6ff-149d-4f3b-8eae-97798b4f0188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188', 'volume_size': 1} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-7be01ead-2313-406b-889a-24297cac3889" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-7be01ead-2313-406b-889a-24297cac3889" acquired by "delete_volume" :: waited 0.032s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7dab38-0b89-40e0-a6d7-1060c4878ce0]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:43 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889 Jul 03 01:08:43 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:44 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de39d3e5-c3ee-4163-bebc-72fb1b340985 1073741824" returned: 0 in 1.034s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de39d3e5-c3ee-4163-bebc-72fb1b340985 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:44 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de39d3e5-c3ee-4163-bebc-72fb1b340985 Jul 03 01:08:44 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:44 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889" returned: 0 in 0.946s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:44 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889 Jul 03 01:08:44 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:44 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de39d3e5-c3ee-4163-bebc-72fb1b340985" returned: 0 in 0.875s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.822s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-671360253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0bab6ff-149d-4f3b-8eae-97798b4f0188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42235ddcdb034f389ceb28cb6d00e86d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:43Z,use_quota=True,user_id='e6b05068f22c4e009f80006691300890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Creating volume d0bab6ff-149d-4f3b-8eae-97798b4f0188 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:08:44 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:08:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca62cd2-1077-4725-ba79-b40769fec54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de39d3e5-c3ee-4163-bebc-72fb1b340985', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e21653-de84-4237-91f3-bc67dee46e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:45 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188 1073741824 Jul 03 01:08:45 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:45 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Volume volume-de39d3e5-c3ee-4163-bebc-72fb1b340985 (de39d3e5-c3ee-4163-bebc-72fb1b340985): created successfully Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e21653-de84-4237-91f3-bc67dee46e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Flow 'volume_create_manager' (54d9414b-7729-4b7b-8d32-e4d143b39dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:45 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-c6b90b99-efb5-497d-999c-c9d415eb2896 req-be5e529b-a45a-493e-ab15-01ccd27c7982 tempest-VolumesGetTestJSON-1625217210 None] Created volume successfully. Jul 03 01:08:45 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7be01ead-2313-406b-889a-24297cac3889" returned: 0 in 1.041s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-7be01ead-2313-406b-889a-24297cac3889" released by "delete_volume" :: held 2.063s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Created reservations ['e0741c70-e54c-4b0e-8177-f40a52ef7275'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:45 devstack cinder-volume[86357]: WARNING cinder.quota [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-506208882 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-506208882, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:08:45 devstack cinder-volume[86357]: WARNING cinder.quota [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-506208882 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-506208882, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Created reservations ['097c13c7-5dbc-4f4f-a1ef-ee761eb5a89c', '6afa5ed5-7c8f-483e-be96-774a996497d6', 'c0083f54-6fec-4ecf-8cd6-db2b4a12118c', '19820d27-13a0-446f-8dd2-2b9305fc4a8a'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:45 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:08:45 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:46 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188 1073741824" returned: 0 in 1.024s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:46 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188 Jul 03 01:08:46 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:46 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.759s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Acquiring lock "cinder-de39d3e5-c3ee-4163-bebc-72fb1b340985-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:46 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-45947265-3a2e-4fc7-b26a-4cd68d24a494 tempest-GroupSnapshotsTest-620191198 None] Delete group completed successfully. Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Lock "cinder-de39d3e5-c3ee-4163-bebc-72fb1b340985-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Acquiring lock "cinder-quobyte-de39d3e5-c3ee-4163-bebc-72fb1b340985" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Lock "cinder-quobyte-de39d3e5-c3ee-4163-bebc-72fb1b340985" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1a2636-0407-4fbd-b653-52f9bd533dca]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de39d3e5-c3ee-4163-bebc-72fb1b340985 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:46 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de39d3e5-c3ee-4163-bebc-72fb1b340985 Jul 03 01:08:46 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:46 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] group_snapshot 3a175082-17d9-4ba8-9f68-cfd228ab9808: deleting Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] group_snapshot 3a175082-17d9-4ba8-9f68-cfd228ab9808: deleting {{(pid=86357) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 01:08:46 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-c73841e6-c6e0-428e-9098-331eb0789176" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188" returned: 0 in 0.774s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096dc4e4-7ceb-4132-ac0b-b07f8e263e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f900f04-9fad-4b34-a011-3dc6210fa8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-c73841e6-c6e0-428e-9098-331eb0789176" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-42777791-c5b6-4fed-8923-3cc79002609c" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:46 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Volume volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188 (d0bab6ff-149d-4f3b-8eae-97798b4f0188): created successfully Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f900f04-9fad-4b34-a011-3dc6210fa8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Flow 'volume_create_manager' (b36fe7ad-b6d7-476d-94e5-c3132c311ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-42777791-c5b6-4fed-8923-3cc79002609c" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Deleting offline snapshot 42777791-c5b6-4fed-8923-3cc79002609c of volume c73841e6-c6e0-428e-9098-331eb0789176 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:08:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] snapshot_file for this snap is: volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:08:47 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8538cc8-3493-4648-8116-01aafa07a53a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:47 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-387372a2-0e3f-4b17-8030-e5b28152265d tempest-ServerRescueNegativeTestJSON-491646889 None] Created volume successfully. Jul 03 01:08:47 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c Jul 03 01:08:47 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:47 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de39d3e5-c3ee-4163-bebc-72fb1b340985" returned: 0 in 1.126s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de39d3e5-c3ee-4163-bebc-72fb1b340985 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:47 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de39d3e5-c3ee-4163-bebc-72fb1b340985 Jul 03 01:08:47 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:48 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c" returned: 0 in 1.043s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c73841e6-c6e0-428e-9098-331eb0789176(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:08:48 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[8130046e-c9b7-40c1-a8c4-31c94abee703]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:48 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 Jul 03 01:08:48 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:48 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de39d3e5-c3ee-4163-bebc-72fb1b340985" returned: 0 in 0.750s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Lock "cinder-quobyte-de39d3e5-c3ee-4163-bebc-72fb1b340985" released by "delete_volume" :: held 1.919s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:48 devstack cinder-volume[86357]: DEBUG cinder.quota [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Created reservations ['1bf8822a-5a59-4c01-a27b-0b4fcfcb8f11', '3a3cbce2-3166-4720-bbaa-8d6480c45cde', '8e0d2c56-ebda-4c82-b57d-8eea50c50200', 'c0e7ca27-41f8-4a16-9682-bf4ca313e1ea'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:48 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:08:48 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:49 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176" returned: 0 in 1.280s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:49 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c Jul 03 01:08:49 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:49 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.959s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:49 devstack cinder-volume[86357]: DEBUG cinder.manager [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:08:49 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Deleted volume successfully. Jul 03 01:08:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-3742309c-4496-499c-a878-0219473e8671 req-9f894280-5e85-4ccf-a9ba-134aa3c6e4a9 tempest-VolumesGetTestJSON-1625217210 None] Lock "cinder-de39d3e5-c3ee-4163-bebc-72fb1b340985-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:50 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c" returned: 0 in 0.938s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:50 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c Jul 03 01:08:50 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:51 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176.42777791-c5b6-4fed-8923-3cc79002609c" returned: 0 in 0.744s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-42777791-c5b6-4fed-8923-3cc79002609c" released by "_delete_snapshot" :: held 4.153s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-c73841e6-c6e0-428e-9098-331eb0789176" released by "delete_snapshot" :: held 4.202s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:51 devstack cinder-volume[86357]: WARNING cinder.quota [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-506208882 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-506208882, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:08:51 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] Created reservations ['16b964fa-9ba4-4b54-bffa-42e4e328d466', '0df8bf22-c1ad-4bce-a2a7-b7dfcd44fb0c', '6fdc24ab-16a4-4917-be3f-87dcbc4224bc', '755cf940-3082-4451-976e-89ddc6495aae'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:51 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-617d8771-493f-42d9-a811-1ca4ac87eafa tempest-GroupSnapshotsTest-620191198 None] group_snapshot 3a175082-17d9-4ba8-9f68-cfd228ab9808: deleted successfully Jul 03 01:08:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-c73841e6-c6e0-428e-9098-331eb0789176" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-c73841e6-c6e0-428e-9098-331eb0789176" acquired by "delete_volume" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:52 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b002b18-d59e-4c3c-b40a-332893db2656]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:52 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 Jul 03 01:08:52 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:53 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176" returned: 0 in 0.895s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:53 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176 Jul 03 01:08:53 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:54 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c73841e6-c6e0-428e-9098-331eb0789176" returned: 0 in 0.837s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:54 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-c73841e6-c6e0-428e-9098-331eb0789176" released by "delete_volume" :: held 1.801s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:54 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Created reservations ['80cb89e8-b8e8-42ce-8f70-4b211b12ece4'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:54 devstack cinder-volume[86357]: WARNING cinder.db.api [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-506208882'] Jul 03 01:08:54 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Created reservations ['c3032169-9998-4f32-b322-4f0acc62859c', '08155e80-88db-4a3c-ba5e-364cc1cb34be', '75db18fe-a976-49a3-be27-9ae786b2206d', 'f2a3051c-6206-4d06-937c-91144a740bfa'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:54 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:08:54 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:55 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.774s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:55 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:08:55 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d700ca34-b4df-43c0-998b-22658821af70 tempest-GroupSnapshotsTest-620191198 None] Delete group completed successfully. Jul 03 01:08:55 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ae3912ce-4860-4224-a5bd-2324149e5c9c tempest-GroupSnapshotsTest-620191198 None] Group tempest-GroupSnapshotsTest-Group-1857219915: creating Jul 03 01:08:55 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ae3912ce-4860-4224-a5bd-2324149e5c9c tempest-GroupSnapshotsTest-620191198 None] Group tempest-GroupSnapshotsTest-Group-1857219915: created successfully Jul 03 01:08:55 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ae3912ce-4860-4224-a5bd-2324149e5c9c tempest-GroupSnapshotsTest-620191198 None] Create group completed successfully. Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Flow 'volume_create_manager' (793f8512-5a85-40ff-8109-d48ed0228b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a90928-8f5d-4ea7-baa0-3913aa125a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a90928-8f5d-4ea7-baa0-3913aa125a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2063808931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14ecf254-969f-4c4f-974d-d211b8683b8d,host='devstack@QuobyteHD#QuobyteHD',id=b0bab56a-0d71-401c-af65-3aabd806caf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1be8fab2703645f785faf079d7695abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:58Z,use_quota=True,user_id='321a6e6f2da0499d9324e3b8a50fa2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6584d13-3f56-4d97-b600-e03f331fcf8f),volume_type_id=d6584d13-3f56-4d97-b600-e03f331fcf8f)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55407832-4481-4682-ba86-8311f1514c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55407832-4481-4682-ba86-8311f1514c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356a3cd5-356e-4bf6-a35e-1f15fe9e1776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356a3cd5-356e-4bf6-a35e-1f15fe9e1776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0bab56a-0d71-401c-af65-3aabd806caf9', 'volume_name': 'volume-b0bab56a-0d71-401c-af65-3aabd806caf9', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7f8505-e8c2-43f5-b168-70b7d06f59ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7f8505-e8c2-43f5-b168-70b7d06f59ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47055167-12e4-4cf5-acd8-82501d05d39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:57 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Volume b0bab56a-0d71-401c-af65-3aabd806caf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0bab56a-0d71-401c-af65-3aabd806caf9', 'volume_size': 1} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=14ecf254-969f-4c4f-974d-d211b8683b8d,created_at=2026-07-02T23:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2063808931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14ecf254-969f-4c4f-974d-d211b8683b8d,host='devstack@QuobyteHD#QuobyteHD',id=b0bab56a-0d71-401c-af65-3aabd806caf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1be8fab2703645f785faf079d7695abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:58Z,use_quota=True,user_id='321a6e6f2da0499d9324e3b8a50fa2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6584d13-3f56-4d97-b600-e03f331fcf8f),volume_type_id=d6584d13-3f56-4d97-b600-e03f331fcf8f)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Creating volume b0bab56a-0d71-401c-af65-3aabd806caf9 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:08:57 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:08:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:57 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9 1073741824 Jul 03 01:08:57 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:59 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9 1073741824" returned: 0 in 1.228s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:59 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9 Jul 03 01:08:59 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:59 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-81e43d68-0511-41a7-a3c4-5fa60c0d4cda tempest-BackendsCapabilitiesAdminTestsJSON-768185709 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545623779297, 'free_capacity_gb': 1775.7545623779297, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86357) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 01:08:59 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-92ee8757-c38a-4f61-b3ae-9efe3d8f37b8 tempest-BackendsCapabilitiesAdminTestsJSON-768185709 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545623779297, 'free_capacity_gb': 1775.7545623779297, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86357) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 01:08:59 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9" returned: 0 in 0.769s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:59 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:08:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:59 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47055167-12e4-4cf5-acd8-82501d05d39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0bab56a-0d71-401c-af65-3aabd806caf9', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:59 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb037ac-a0b0-49a2-9b24-b25de9813382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:00 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Volume volume-b0bab56a-0d71-401c-af65-3aabd806caf9 (b0bab56a-0d71-401c-af65-3aabd806caf9): created successfully Jul 03 01:09:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb037ac-a0b0-49a2-9b24-b25de9813382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Flow 'volume_create_manager' (793f8512-5a85-40ff-8109-d48ed0228b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:09:00 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b113df34-0013-41ad-ad2e-e81baa428fcc tempest-GroupSnapshotsTest-620191198 None] Created volume successfully. Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Flow 'volume_create_manager' (673608f1-bb10-4f6d-bc42-06b909321cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dc40cd-1a3a-4efd-9949-f6bb599ddf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dc40cd-1a3a-4efd-9949-f6bb599ddf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1828045766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14ecf254-969f-4c4f-974d-d211b8683b8d,host='devstack@QuobyteHD#QuobyteHD',id=4972ca44-727c-4342-a3a4-8d0376191889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1be8fab2703645f785faf079d7695abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:02Z,use_quota=True,user_id='321a6e6f2da0499d9324e3b8a50fa2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6584d13-3f56-4d97-b600-e03f331fcf8f),volume_type_id=d6584d13-3f56-4d97-b600-e03f331fcf8f)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1aeac6-53e8-4527-b163-0985bfdf57e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1aeac6-53e8-4527-b163-0985bfdf57e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f40de2-5f11-4cee-bd62-62cb8ab5a70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f40de2-5f11-4cee-bd62-62cb8ab5a70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4972ca44-727c-4342-a3a4-8d0376191889', 'volume_name': 'volume-4972ca44-727c-4342-a3a4-8d0376191889', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3426a55b-a487-4481-aa28-7307b04c56a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3426a55b-a487-4481-aa28-7307b04c56a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35fb1e4-f6c7-4783-bc2f-04d5a08937d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:01 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Volume 4972ca44-727c-4342-a3a4-8d0376191889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4972ca44-727c-4342-a3a4-8d0376191889', 'volume_size': 1} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=14ecf254-969f-4c4f-974d-d211b8683b8d,created_at=2026-07-02T23:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1828045766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14ecf254-969f-4c4f-974d-d211b8683b8d,host='devstack@QuobyteHD#QuobyteHD',id=4972ca44-727c-4342-a3a4-8d0376191889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1be8fab2703645f785faf079d7695abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:02Z,use_quota=True,user_id='321a6e6f2da0499d9324e3b8a50fa2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6584d13-3f56-4d97-b600-e03f331fcf8f),volume_type_id=d6584d13-3f56-4d97-b600-e03f331fcf8f)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Creating volume 4972ca44-727c-4342-a3a4-8d0376191889 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:09:01 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:09:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:01 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889 1073741824 Jul 03 01:09:01 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:03 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889 1073741824" returned: 0 in 1.874s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:03 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889 Jul 03 01:09:03 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:05 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889" returned: 0 in 1.160s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] <== create_volume: return (3150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:09:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.153s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35fb1e4-f6c7-4783-bc2f-04d5a08937d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4972ca44-727c-4342-a3a4-8d0376191889', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58010d6-7ed3-4643-9fa6-440796696133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:05 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Volume volume-4972ca44-727c-4342-a3a4-8d0376191889 (4972ca44-727c-4342-a3a4-8d0376191889): created successfully Jul 03 01:09:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58010d6-7ed3-4643-9fa6-440796696133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Flow 'volume_create_manager' (673608f1-bb10-4f6d-bc42-06b909321cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:09:05 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-584cffb3-2961-41b1-9d1b-87c4cc6b1664 tempest-GroupSnapshotsTest-620191198 None] Created volume successfully. Jul 03 01:09:06 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b43acd71-5f1f-4606-98fc-d6a1410d8e86 tempest-GroupSnapshotsTest-620191198 None] Update group completed successfully. Jul 03 01:09:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Acquiring lock "cinder-d0bab6ff-149d-4f3b-8eae-97798b4f0188-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Lock "cinder-d0bab6ff-149d-4f3b-8eae-97798b4f0188-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Acquiring lock "cinder-quobyte-d0bab6ff-149d-4f3b-8eae-97798b4f0188" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Lock "cinder-quobyte-d0bab6ff-149d-4f3b-8eae-97798b4f0188" acquired by "delete_volume" :: waited 0.049s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:07 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6b7bd9-c32c-40d0-b334-94fb7bb03685]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:07 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188 Jul 03 01:09:07 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:07 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3a63355c-ed27-4333-8d8f-7967a5f7aaeb tempest-GroupSnapshotsTest-620191198 None] Update group completed successfully. Jul 03 01:09:08 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188" returned: 0 in 1.213s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:08 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188 Jul 03 01:09:08 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:08 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-dddb9a24-fd42-4902-bdf6-882f769270cd tempest-GroupSnapshotsTest-620191198 None] Update group completed successfully. Jul 03 01:09:09 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d0bab6ff-149d-4f3b-8eae-97798b4f0188" returned: 0 in 1.186s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:09 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Lock "cinder-quobyte-d0bab6ff-149d-4f3b-8eae-97798b4f0188" released by "delete_volume" :: held 2.492s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:09 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Created reservations ['369ed43a-274e-436d-9174-9bcb068839ad', 'ed6dbdc0-9d0e-47a1-8c49-e9ed1d5e466c', '0d8b3375-90af-497c-a657-5a476f348181', '40a38a7b-7123-4ca0-8694-a48cd4290c8d'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:09:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:09:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:09:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:09 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:09:09 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:10 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d949d8c4-3c45-4e37-ab23-c238c18bbc98 tempest-GroupSnapshotsTest-620191198 None] Update group completed successfully. Jul 03 01:09:10 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ac843a12-770d-4c90-80fe-b33ece62aea6 tempest-GroupSnapshotsV319Test-855025560 None] Group tempest-GroupSnapshotsV319Test-Group-731338322: creating Jul 03 01:09:10 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ac843a12-770d-4c90-80fe-b33ece62aea6 tempest-GroupSnapshotsV319Test-855025560 None] Group tempest-GroupSnapshotsV319Test-Group-731338322: created successfully Jul 03 01:09:10 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ac843a12-770d-4c90-80fe-b33ece62aea6 tempest-GroupSnapshotsV319Test-855025560 None] Create group completed successfully. Jul 03 01:09:10 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.954s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:10 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:09:10 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Deleted volume successfully. Jul 03 01:09:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8ddfb7c0-f8aa-4aee-9dcd-7043e82727c3 tempest-ServerRescueNegativeTestJSON-491646889 None] Lock "cinder-d0bab6ff-149d-4f3b-8eae-97798b4f0188-delete_volume" released by "delete_volume" :: held 3.867s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:12 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] GroupSnapshot 989173d6-fae6-4424-9986-750ae1f7039f: creating. Jul 03 01:09:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Group snapshot 989173d6-fae6-4424-9986-750ae1f7039f: creating. {{(pid=86357) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 01:09:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Creating offline snapshot b273e5cc-31c1-405d-b082-d625f0ccd25e of volume 4972ca44-727c-4342-a3a4-8d0376191889 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:09:12 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36ac98d-48ae-43c9-9c4e-3484ab3a17f0]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:12 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889 Jul 03 01:09:12 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:13 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:09:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Flow 'volume_create_manager' (08600e34-fce9-4cbc-a424-cbb47969bd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:09:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bb9f67-ea71-4b6e-b687-555b4c49f357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bb9f67-ea71-4b6e-b687-555b4c49f357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-560358147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25db360b-d0e7-451a-8a13-0abdd319725f,host='devstack@QuobyteHD#QuobyteHD',id=0e9abea0-fa9a-4682-8f78-c7d6725bd626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15338460fd854015b8b7d5862e767003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:13Z,use_quota=True,user_id='233dc8e6682d42048940e0016be4404c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1265921-a515-4d10-8171-8ff92215b68c),volume_type_id=a1265921-a515-4d10-8171-8ff92215b68c)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9b5209-b4ad-4a73-95e1-7c551f21e54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9b5209-b4ad-4a73-95e1-7c551f21e54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c4c2fd-a7f5-4394-bd10-fb07885bba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c4c2fd-a7f5-4394-bd10-fb07885bba46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e9abea0-fa9a-4682-8f78-c7d6725bd626', 'volume_name': 'volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823249e7-cf20-4ce9-83ca-c63746e4a26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823249e7-cf20-4ce9-83ca-c63746e4a26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ee1a74-ff0b-4d2e-a4f1-25c792054413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:13 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Volume 0e9abea0-fa9a-4682-8f78-c7d6725bd626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626', 'volume_size': 1} Jul 03 01:09:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:14 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889" returned: 0 in 1.715s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:14 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e 1G Jul 03 01:09:14 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:15 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e 1G" returned: 0 in 1.033s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4972ca44-727c-4342-a3a4-8d0376191889 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:15 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4972ca44-727c-4342-a3a4-8d0376191889 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e Jul 03 01:09:15 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:16 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4972ca44-727c-4342-a3a4-8d0376191889 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e" returned: 0 in 0.881s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:16 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:09:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:16 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e Jul 03 01:09:16 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:16 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e" returned: 0 in 0.685s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:16 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.info Jul 03 01:09:16 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:17 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.info" returned: 0 in 0.789s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:17 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:09:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:17 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.info Jul 03 01:09:17 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:18 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.info" returned: 0 in 0.704s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.032s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Creating offline snapshot cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 of volume b0bab56a-0d71-401c-af65-3aabd806caf9 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:09:18 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4ddbb4-a66c-40c2-aefe-4e67cf8f213b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:18 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9 Jul 03 01:09:18 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:19 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9" returned: 0 in 0.759s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:19 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 1G Jul 03 01:09:19 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:20 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 1G" returned: 0 in 1.193s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0bab56a-0d71-401c-af65-3aabd806caf9 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:20 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0bab56a-0d71-401c-af65-3aabd806caf9 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 Jul 03 01:09:20 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:21 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0bab56a-0d71-401c-af65-3aabd806caf9 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67" returned: 0 in 0.871s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:21 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:09:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:21 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 Jul 03 01:09:21 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:22 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67" returned: 0 in 0.807s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:22 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.info Jul 03 01:09:22 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:22 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.info" returned: 0 in 0.680s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:22 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:09:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:22 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.info Jul 03 01:09:22 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:23 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.info" returned: 0 in 0.665s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.066s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.207s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=25db360b-d0e7-451a-8a13-0abdd319725f,created_at=2026-07-02T23:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-560358147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25db360b-d0e7-451a-8a13-0abdd319725f,host='devstack@QuobyteHD#QuobyteHD',id=0e9abea0-fa9a-4682-8f78-c7d6725bd626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15338460fd854015b8b7d5862e767003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:13Z,use_quota=True,user_id='233dc8e6682d42048940e0016be4404c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1265921-a515-4d10-8171-8ff92215b68c),volume_type_id=a1265921-a515-4d10-8171-8ff92215b68c)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:09:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Creating volume 0e9abea0-fa9a-4682-8f78-c7d6725bd626 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:09:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:09:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:09:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:09:23 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:09:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:23 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 1073741824 Jul 03 01:09:23 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:23 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-203f6d5c-dcd6-4fee-9120-0ed4e3fc8bea tempest-GroupSnapshotsTest-620191198 None] group_snapshot 989173d6-fae6-4424-9986-750ae1f7039f: created successfully Jul 03 01:09:24 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] group_snapshot 989173d6-fae6-4424-9986-750ae1f7039f: deleting Jul 03 01:09:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] group_snapshot 989173d6-fae6-4424-9986-750ae1f7039f: deleting {{(pid=86357) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 01:09:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-4972ca44-727c-4342-a3a4-8d0376191889" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-4972ca44-727c-4342-a3a4-8d0376191889" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-b273e5cc-31c1-405d-b082-d625f0ccd25e" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-b273e5cc-31c1-405d-b082-d625f0ccd25e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Deleting offline snapshot b273e5cc-31c1-405d-b082-d625f0ccd25e of volume 4972ca44-727c-4342-a3a4-8d0376191889 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:09:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] snapshot_file for this snap is: volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:09:24 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdc3c5b-cd08-499b-8385-d8cb003b847d]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:24 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 1073741824" returned: 0 in 1.106s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:24 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e Jul 03 01:09:24 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:24 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 Jul 03 01:09:24 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:25 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e" returned: 0 in 0.888s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4972ca44-727c-4342-a3a4-8d0376191889(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:09:25 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d65b863-fe58-4e82-8457-9b16aca221c2]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:25 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626" returned: 0 in 0.760s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:09:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ee1a74-ff0b-4d2e-a4f1-25c792054413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334c73c0-7004-4c01-8fd4-747ccee8e354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:25 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Volume volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 (0e9abea0-fa9a-4682-8f78-c7d6725bd626): created successfully Jul 03 01:09:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334c73c0-7004-4c01-8fd4-747ccee8e354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Flow 'volume_create_manager' (08600e34-fce9-4cbc-a424-cbb47969bd26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:09:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-28df701b-40de-4f96-95bb-6afda41abc70 tempest-GroupSnapshotsV319Test-855025560 None] Created volume successfully. Jul 03 01:09:25 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889 Jul 03 01:09:25 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:26 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889" returned: 0 in 0.805s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:26 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e Jul 03 01:09:26 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:26 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] GroupSnapshot 8961b71e-4a76-41f2-8b87-aac203e84d38: creating. Jul 03 01:09:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] Group snapshot 8961b71e-4a76-41f2-8b87-aac203e84d38: creating. {{(pid=86357) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 01:09:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] Creating offline snapshot 23f8af23-11d1-4d61-8e46-806171224e59 of volume 0e9abea0-fa9a-4682-8f78-c7d6725bd626 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:09:26 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08b8c6b-89fa-407f-88de-7db2a618c4e9]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:26 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 Jul 03 01:09:26 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:27 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e" returned: 0 in 0.890s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:27 devstack sudo[91430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e Jul 03 01:09:27 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:09:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:09:27 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:09:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626" returned: 0 in 1.154s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:27 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:09:27 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:27 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 1G Jul 03 01:09:27 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:28 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889.b273e5cc-31c1-405d-b082-d625f0ccd25e" returned: 0 in 1.022s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:28 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-b273e5cc-31c1-405d-b082-d625f0ccd25e" released by "_delete_snapshot" :: held 3.796s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:28 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-4972ca44-727c-4342-a3a4-8d0376191889" released by "delete_snapshot" :: held 3.836s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:28 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-b0bab56a-0d71-401c-af65-3aabd806caf9" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:28 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-b0bab56a-0d71-401c-af65-3aabd806caf9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:28 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:28 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Deleting offline snapshot cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 of volume b0bab56a-0d71-401c-af65-3aabd806caf9 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:09:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] snapshot_file for this snap is: volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:09:28 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd02979d-499c-4c00-add2-d80b33f142a7]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:28 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 Jul 03 01:09:28 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:29 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.379s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:29 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:09:29 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 1G" returned: 0 in 1.679s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:29 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 Jul 03 01:09:29 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:29 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67" returned: 0 in 1.430s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:29 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0bab56a-0d71-401c-af65-3aabd806caf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:09:29 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0058c812-37ec-46fc-870b-8a181c46bd28]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:30 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9 Jul 03 01:09:30 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:30 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59" returned: 0 in 1.409s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:30 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:09:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:30 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 Jul 03 01:09:30 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:31 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9" returned: 0 in 1.363s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:31 devstack sudo[91531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 Jul 03 01:09:31 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:32 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59" returned: 0 in 1.347s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:32 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.info Jul 03 01:09:32 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:32 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67" returned: 0 in 1.287s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:32 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67 Jul 03 01:09:32 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:33 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.info" returned: 0 in 1.145s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:33 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:09:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:33 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.info Jul 03 01:09:33 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:33 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9.cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67" returned: 0 in 1.207s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-cf1f7546-1f76-4b3a-aa9b-cb59bd5f6d67" released by "_delete_snapshot" :: held 5.481s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-b0bab56a-0d71-401c-af65-3aabd806caf9" released by "delete_snapshot" :: held 5.531s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:33 devstack cinder-volume[86357]: WARNING cinder.quota [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-391293056 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-391293056, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:09:33 devstack cinder-volume[86357]: WARNING cinder.quota [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-391293056 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-391293056, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:09:33 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Created reservations ['5e94a192-33e2-435f-a7ed-dae698dd9b22', 'c5122730-71d4-4e20-ac7b-63fe9b4d99dc', 'b4678c86-2e09-45c6-aba9-87fcb4da3829', '962739e7-c04a-4fe3-9af5-1f364c1986e3'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:09:34 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=65,cinder:SELECT=82,cinder:DELETE=5,cinder:INSERT=19 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:09:34 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] Created reservations ['8404f914-3dfb-4a15-8e8c-f8ce92e46a9c', '8fa70a44-a393-44f8-a132-da3b5764d466', '81d04787-47a7-4fb1-8a0b-f4cc2250afbc', '4538d224-c33f-4e17-b81b-c92dd19af40a'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:09:34 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=95,cinder:SELECT=75,cinder:INSERT=19,cinder:DELETE=2 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:09:34 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-cc68743b-e201-4b78-9eaa-ce8a36a4cc4a tempest-GroupSnapshotsTest-620191198 None] group_snapshot 989173d6-fae6-4424-9986-750ae1f7039f: deleted successfully Jul 03 01:09:34 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.info" returned: 0 in 1.150s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:34 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-0333a76d-7fe8-404e-8021-acfa9836d451 tempest-GroupSnapshotsV319Test-855025560 None] group_snapshot 8961b71e-4a76-41f2-8b87-aac203e84d38: created successfully Jul 03 01:09:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-4972ca44-727c-4342-a3a4-8d0376191889" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-4972ca44-727c-4342-a3a4-8d0376191889" acquired by "delete_volume" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:35 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f719111d-e6d8-418a-81e0-6a7e3289d7ee]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:35 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889 Jul 03 01:09:35 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:36 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] group_snapshot 8961b71e-4a76-41f2-8b87-aac203e84d38: deleting Jul 03 01:09:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] group_snapshot 8961b71e-4a76-41f2-8b87-aac203e84d38: deleting {{(pid=86357) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 01:09:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Acquiring lock "cinder-quobyte-0e9abea0-fa9a-4682-8f78-c7d6725bd626" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Lock "cinder-quobyte-0e9abea0-fa9a-4682-8f78-c7d6725bd626" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Acquiring lock "cinder-quobyte-23f8af23-11d1-4d61-8e46-806171224e59" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Lock "cinder-quobyte-23f8af23-11d1-4d61-8e46-806171224e59" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Deleting offline snapshot 23f8af23-11d1-4d61-8e46-806171224e59 of volume 0e9abea0-fa9a-4682-8f78-c7d6725bd626 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:09:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] snapshot_file for this snap is: volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:09:36 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fe70fa-117e-41b0-9ee9-dd188b997749]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:36 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 Jul 03 01:09:36 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:36 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889" returned: 0 in 1.305s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:36 devstack sudo[91559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889 Jul 03 01:09:36 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:37 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59" returned: 0 in 1.196s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:09:37 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f1325d-af3f-4f44-bf96-40f9576ff1f8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:37 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 Jul 03 01:09:37 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:37 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4972ca44-727c-4342-a3a4-8d0376191889" returned: 0 in 1.286s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-4972ca44-727c-4342-a3a4-8d0376191889" released by "delete_volume" :: held 2.718s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-b0bab56a-0d71-401c-af65-3aabd806caf9" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-b0bab56a-0d71-401c-af65-3aabd806caf9" acquired by "delete_volume" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:38 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[50174db0-71c1-4561-b52a-f9e5cdb2fb3d]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:38 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9 Jul 03 01:09:38 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:38 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626" returned: 0 in 1.341s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:38 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 Jul 03 01:09:38 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:39 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9" returned: 0 in 0.996s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:39 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9 Jul 03 01:09:39 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:39 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0bab56a-0d71-401c-af65-3aabd806caf9" returned: 0 in 0.866s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-b0bab56a-0d71-401c-af65-3aabd806caf9" released by "delete_volume" :: held 1.972s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:40 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59" returned: 0 in 1.120s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:40 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Created reservations ['aeeca58c-8917-44bb-8554-48ad3e9e9fd2'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:09:40 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59 Jul 03 01:09:40 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:40 devstack cinder-volume[86357]: WARNING cinder.quota [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-391293056 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-391293056, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:09:40 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Created reservations ['0da855d2-7563-48d0-b313-98ed445dac93', 'd2987e72-420a-4f33-8f34-cf7fc7c13d43', '813da78c-5a22-410a-ac1f-33b4d9c1ff53', 'a8e2f19a-0507-4231-8bdd-205f67fb318b'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:09:40 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Created reservations ['15b700aa-703a-4515-9b9c-ec4575ca1058', 'eee0d808-618b-4f37-ac69-1eed0c80256c', '402150da-3761-4729-9404-3000a12a9a3f', '99d742e3-2cd2-4457-8398-8522cd8b0f44'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:09:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:09:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:09:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:40 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:09:40 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:41 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626.23f8af23-11d1-4d61-8e46-806171224e59" returned: 0 in 0.984s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Lock "cinder-quobyte-23f8af23-11d1-4d61-8e46-806171224e59" released by "_delete_snapshot" :: held 4.831s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Lock "cinder-quobyte-0e9abea0-fa9a-4682-8f78-c7d6725bd626" released by "delete_snapshot" :: held 4.867s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:41 devstack cinder-volume[86357]: WARNING cinder.quota [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1895360524 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1895360524, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:09:41 devstack cinder-volume[86357]: WARNING cinder.quota [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1895360524 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1895360524, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:09:41 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] Created reservations ['74c54b78-6460-4b86-ac9f-431b5b6d22a1', '21aa8d5f-3d5a-4280-b8ce-cb9f0f121f3d', '4f4a95a4-f928-4a45-97a5-09d242a5a1e8', '6de3b813-659e-44c5-a474-40535e5bb477'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:09:41 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b8e57acd-0f40-439e-816f-ac616ac595e4 tempest-GroupSnapshotsV319Test-855025560 None] group_snapshot 8961b71e-4a76-41f2-8b87-aac203e84d38: deleted successfully Jul 03 01:09:41 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.904s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:41 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:09:41 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4bb4fc76-42cf-4e9d-9777-c7514ff072b0 tempest-GroupSnapshotsTest-620191198 None] Delete group completed successfully. Jul 03 01:09:42 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-adb68145-bdf2-4525-9cc7-5086fe4209a0 tempest-GroupSnapshotsTest-620191198 None] Group tempest-GroupSnapshotsTest-Group-994435925: creating Jul 03 01:09:42 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-adb68145-bdf2-4525-9cc7-5086fe4209a0 tempest-GroupSnapshotsTest-620191198 None] Group tempest-GroupSnapshotsTest-Group-994435925: created successfully Jul 03 01:09:42 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-adb68145-bdf2-4525-9cc7-5086fe4209a0 tempest-GroupSnapshotsTest-620191198 None] Create group completed successfully. Jul 03 01:09:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Acquiring lock "cinder-quobyte-0e9abea0-fa9a-4682-8f78-c7d6725bd626" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Lock "cinder-quobyte-0e9abea0-fa9a-4682-8f78-c7d6725bd626" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:42 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[283a5e4d-e766-4aff-87a6-6b6c8fd30179]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:42 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 Jul 03 01:09:42 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:43 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626" returned: 0 in 0.811s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:43 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626 Jul 03 01:09:43 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:43 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:09:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Flow 'volume_create_manager' (db563215-3b8d-43e9-8818-4b3624689ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:09:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cba4eba-834a-43f8-b698-680d04845bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cba4eba-834a-43f8-b698-680d04845bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951668855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9de4e6cf-c039-4197-812b-5fe221e09c83,host='devstack@QuobyteHD#QuobyteHD',id=a0687207-6f00-4948-94b2-2892a01e6edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1be8fab2703645f785faf079d7695abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:44Z,use_quota=True,user_id='321a6e6f2da0499d9324e3b8a50fa2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eeb15216-39f3-4816-ad88-5b2df0f7e6c3),volume_type_id=eeb15216-39f3-4816-ad88-5b2df0f7e6c3)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (046e65fe-cdeb-499c-824a-648212bbf021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (046e65fe-cdeb-499c-824a-648212bbf021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86fc394-f465-4480-ae4e-84f4b9d10217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86fc394-f465-4480-ae4e-84f4b9d10217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0687207-6f00-4948-94b2-2892a01e6edb', 'volume_name': 'volume-a0687207-6f00-4948-94b2-2892a01e6edb', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460a6542-dda8-4a7c-80f4-2a148d280a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460a6542-dda8-4a7c-80f4-2a148d280a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da8c0b8-60a0-4c16-a57b-d11fb5a06680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:44 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Volume a0687207-6f00-4948-94b2-2892a01e6edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0687207-6f00-4948-94b2-2892a01e6edb', 'volume_size': 1} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9de4e6cf-c039-4197-812b-5fe221e09c83,created_at=2026-07-02T23:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951668855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9de4e6cf-c039-4197-812b-5fe221e09c83,host='devstack@QuobyteHD#QuobyteHD',id=a0687207-6f00-4948-94b2-2892a01e6edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1be8fab2703645f785faf079d7695abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:44Z,use_quota=True,user_id='321a6e6f2da0499d9324e3b8a50fa2dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eeb15216-39f3-4816-ad88-5b2df0f7e6c3),volume_type_id=eeb15216-39f3-4816-ad88-5b2df0f7e6c3)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Creating volume a0687207-6f00-4948-94b2-2892a01e6edb {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:09:44 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:09:44 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e9abea0-fa9a-4682-8f78-c7d6725bd626" returned: 0 in 1.004s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:44 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb 1073741824 Jul 03 01:09:44 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Lock "cinder-quobyte-0e9abea0-fa9a-4682-8f78-c7d6725bd626" released by "delete_volume" :: held 1.901s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Created reservations ['e5664d59-52fa-45cc-aa2e-3f6c3adbe29e'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:09:44 devstack cinder-volume[86357]: WARNING cinder.quota [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1895360524 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1895360524, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Created reservations ['80e95099-bf6a-4bd7-8795-7b13e0ab12b8', '040ff125-5fd6-4cd5-bc03-eb0b1720566b', '42362c9b-afa6-4b20-b8a7-80aee857d6aa', '811e4f81-10f9-4ea6-b909-b46c3b547ff6'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:44 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:09:44 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:45 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.850s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:45 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:09:45 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4db57abf-1442-4762-bd11-f28f4e2c30bd tempest-GroupSnapshotsV319Test-855025560 None] Delete group completed successfully. Jul 03 01:09:45 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb 1073741824" returned: 0 in 1.326s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:45 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb Jul 03 01:09:45 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:46 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb" returned: 0 in 0.827s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] <== create_volume: return (2243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:09:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.249s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da8c0b8-60a0-4c16-a57b-d11fb5a06680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0687207-6f00-4948-94b2-2892a01e6edb', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0392596-3069-4dd0-856d-5279ed712fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:46 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Volume volume-a0687207-6f00-4948-94b2-2892a01e6edb (a0687207-6f00-4948-94b2-2892a01e6edb): created successfully Jul 03 01:09:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0392596-3069-4dd0-856d-5279ed712fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Flow 'volume_create_manager' (db563215-3b8d-43e9-8818-4b3624689ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:09:46 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-40a46626-8f76-43df-9b5c-c7f54f98ceb0 tempest-GroupSnapshotsTest-620191198 None] Created volume successfully. Jul 03 01:09:48 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] GroupSnapshot 76e78ecd-f92f-434d-9f17-9ce62e09da18: creating. Jul 03 01:09:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] Group snapshot 76e78ecd-f92f-434d-9f17-9ce62e09da18: creating. {{(pid=86357) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 01:09:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] Creating offline snapshot e2ab0943-e460-43a0-980c-2b6d3846db79 of volume a0687207-6f00-4948-94b2-2892a01e6edb {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:09:48 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[1619e0c6-c2b7-4a02-95e1-1a599036a07a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:48 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb Jul 03 01:09:48 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:49 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb" returned: 0 in 1.022s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:49 devstack sudo[91676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 1G Jul 03 01:09:49 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:50 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 1G" returned: 0 in 1.121s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0687207-6f00-4948-94b2-2892a01e6edb -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:50 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0687207-6f00-4948-94b2-2892a01e6edb -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 Jul 03 01:09:50 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:51 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0687207-6f00-4948-94b2-2892a01e6edb -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79" returned: 0 in 0.792s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:51 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:09:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:51 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 Jul 03 01:09:51 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:51 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79" returned: 0 in 0.712s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:52 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.info Jul 03 01:09:52 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:52 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.info" returned: 0 in 0.748s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:52 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:09:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:52 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.info Jul 03 01:09:52 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:53 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.info" returned: 0 in 0.692s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.186s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:53 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-600661af-df10-458d-8938-09d7a4ba5d80 tempest-GroupSnapshotsTest-620191198 None] group_snapshot 76e78ecd-f92f-434d-9f17-9ce62e09da18: created successfully Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Flow 'volume_create_manager' (dfeef693-9f26-46c3-870c-98be79f76ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d1711d-d202-4430-9fce-7b389be4323d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d1711d-d202-4430-9fce-7b389be4323d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1556446242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20719bac-75c5-44bd-99ec-8eb69c87e4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae650ebabc04e35922bf644d2217ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:54Z,use_quota=True,user_id='0d94825c815149f8adf385a02f17658c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374305c2-c253-4657-9555-8759d06be9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374305c2-c253-4657-9555-8759d06be9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1773c363-914f-448d-bac2-ac1790254a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1773c363-914f-448d-bac2-ac1790254a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20719bac-75c5-44bd-99ec-8eb69c87e4a8', 'volume_name': 'volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e7a25b-d89f-4347-a140-f901becc9182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e7a25b-d89f-4347-a140-f901becc9182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ab0c07-17d4-48ee-9992-57ec8cc72c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:54 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Volume 20719bac-75c5-44bd-99ec-8eb69c87e4a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8', 'volume_size': 1} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1556446242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20719bac-75c5-44bd-99ec-8eb69c87e4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae650ebabc04e35922bf644d2217ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:54Z,use_quota=True,user_id='0d94825c815149f8adf385a02f17658c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Creating volume 20719bac-75c5-44bd-99ec-8eb69c87e4a8 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:09:54 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:54 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8 1073741824 Jul 03 01:09:54 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:54 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] group_snapshot 76e78ecd-f92f-434d-9f17-9ce62e09da18: deleting Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] group_snapshot 76e78ecd-f92f-434d-9f17-9ce62e09da18: deleting {{(pid=86357) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 01:09:54 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-a0687207-6f00-4948-94b2-2892a01e6edb" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-a0687207-6f00-4948-94b2-2892a01e6edb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-e2ab0943-e460-43a0-980c-2b6d3846db79" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-e2ab0943-e460-43a0-980c-2b6d3846db79" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Deleting offline snapshot e2ab0943-e460-43a0-980c-2b6d3846db79 of volume a0687207-6f00-4948-94b2-2892a01e6edb {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:09:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] snapshot_file for this snap is: volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:09:55 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8632eb3-985b-4f21-bdd8-c7eb3a05731c]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:55 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 Jul 03 01:09:55 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:55 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8 1073741824" returned: 0 in 1.321s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:55 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8 Jul 03 01:09:55 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:56 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79" returned: 0 in 1.215s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0687207-6f00-4948-94b2-2892a01e6edb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:09:56 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aee618-d78a-438a-a882-98334a5f6f2e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:56 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb Jul 03 01:09:56 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:56 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8" returned: 0 in 0.964s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] <== create_volume: return (2362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:09:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.365s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ab0c07-17d4-48ee-9992-57ec8cc72c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e31c26c-59a2-4a80-a4f3-78d5e153dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:56 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Volume volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8 (20719bac-75c5-44bd-99ec-8eb69c87e4a8): created successfully Jul 03 01:09:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e31c26c-59a2-4a80-a4f3-78d5e153dc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Flow 'volume_create_manager' (dfeef693-9f26-46c3-870c-98be79f76ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:09:56 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-5f7e593e-5566-4f26-855d-95afd8543a2c tempest-AttachVolumeTestJSON-886997686 None] Created volume successfully. Jul 03 01:09:57 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb" returned: 0 in 1.050s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:57 devstack sudo[91747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 Jul 03 01:09:57 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:58 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79" returned: 0 in 0.892s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:58 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79 Jul 03 01:09:58 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:59 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb.e2ab0943-e460-43a0-980c-2b6d3846db79" returned: 0 in 0.692s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-e2ab0943-e460-43a0-980c-2b6d3846db79" released by "_delete_snapshot" :: held 3.997s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-a0687207-6f00-4948-94b2-2892a01e6edb" released by "delete_snapshot" :: held 4.039s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:59 devstack cinder-volume[86357]: WARNING cinder.quota [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-943203049 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-943203049, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:09:59 devstack cinder-volume[86357]: WARNING cinder.quota [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-943203049 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-943203049, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:09:59 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] Created reservations ['5fe633a0-4a79-41ba-ba03-61fade81bfb3', '6591047e-f7ff-4568-954b-8f5ab90c2ad5', 'abec3571-bf20-4e70-974b-173eaeaafec5', '606eb126-d229-4b5b-8c90-045643301f3d'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:09:59 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3babb129-6d31-4d46-86df-0a0831cdb43b tempest-GroupSnapshotsTest-620191198 None] group_snapshot 76e78ecd-f92f-434d-9f17-9ce62e09da18: deleted successfully Jul 03 01:09:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "cinder-quobyte-a0687207-6f00-4948-94b2-2892a01e6edb" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-a0687207-6f00-4948-94b2-2892a01e6edb" acquired by "delete_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:59 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0941bfbf-b321-45c6-8939-9f4d9edf3451]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:00 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb Jul 03 01:10:00 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:00 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb" returned: 0 in 0.975s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-9221de48-c441-4b85-9bd7-5593eaa9d712 req-16c8843a-0941-446a-b72b-7e80843bb3ed tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-9221de48-c441-4b85-9bd7-5593eaa9d712 req-16c8843a-0941-446a-b72b-7e80843bb3ed tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:00 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb Jul 03 01:10:00 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:00 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f874194a-7684-410f-a87b-304576ce80c0]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-9221de48-c441-4b85-9bd7-5593eaa9d712 req-16c8843a-0941-446a-b72b-7e80843bb3ed tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:01 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8 Jul 03 01:10:01 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:01 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0687207-6f00-4948-94b2-2892a01e6edb" returned: 0 in 0.758s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Lock "cinder-quobyte-a0687207-6f00-4948-94b2-2892a01e6edb" released by "delete_volume" :: held 1.811s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:01 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Created reservations ['a49576db-b60c-4418-9f6e-5f7d3a5a0afa'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:01 devstack cinder-volume[86357]: WARNING cinder.quota [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-943203049 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-943203049, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:10:01 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Created reservations ['8fbaf73c-9457-4314-81d9-7290878ba0df', '99e17bae-e9fc-4caa-acc0-0efb3eaa0a9b', '25b7db08-1ab6-4f08-a219-aca88b77d9fd', '34bfe06b-9ba9-4dbe-9a48-58c51b8cbb06'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:01 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-9221de48-c441-4b85-9bd7-5593eaa9d712 req-16c8843a-0941-446a-b72b-7e80843bb3ed tempest-AttachVolumeTestJSON-886997686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8" returned: 0 in 0.924s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-9221de48-c441-4b85-9bd7-5593eaa9d712 req-16c8843a-0941-446a-b72b-7e80843bb3ed tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.948s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-9221de48-c441-4b85-9bd7-5593eaa9d712 req-16c8843a-0941-446a-b72b-7e80843bb3ed tempest-AttachVolumeTestJSON-886997686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08ee1f30-a718-48d8-b660-63732964ed49', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:10:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:01 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:10:01 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:01 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-9221de48-c441-4b85-9bd7-5593eaa9d712 req-16c8843a-0941-446a-b72b-7e80843bb3ed tempest-AttachVolumeTestJSON-886997686 None] attachment_update completed successfully. Jul 03 01:10:03 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.360s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:03 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:03 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-74192085-1be6-415d-9336-801d9f722901 tempest-GroupSnapshotsTest-620191198 None] Delete group completed successfully. Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Flow 'volume_create_manager' (afe164e1-56c5-4c64-9e60-3c5ad74495df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4327f2-a9b0-4f7c-9b77-75e8bfec9fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4327f2-a9b0-4f7c-9b77-75e8bfec9fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-25828555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f320e80-1ac4-451e-a443-39a963479ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae650ebabc04e35922bf644d2217ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:08Z,use_quota=True,user_id='0d94825c815149f8adf385a02f17658c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8330f8b-11ac-49ad-8794-46c7d2a3a435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8330f8b-11ac-49ad-8794-46c7d2a3a435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8f7514-6214-46ed-ab70-dc3b06e0fc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8f7514-6214-46ed-ab70-dc3b06e0fc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f320e80-1ac4-451e-a443-39a963479ff7', 'volume_name': 'volume-7f320e80-1ac4-451e-a443-39a963479ff7', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed1cabc-00b0-41bf-a34f-25d359ce484a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed1cabc-00b0-41bf-a34f-25d359ce484a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef045499-5e75-4b54-8034-2f4444d599fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:08 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Volume 7f320e80-1ac4-451e-a443-39a963479ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f320e80-1ac4-451e-a443-39a963479ff7', 'volume_size': 1} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-25828555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f320e80-1ac4-451e-a443-39a963479ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ae650ebabc04e35922bf644d2217ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:08Z,use_quota=True,user_id='0d94825c815149f8adf385a02f17658c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Creating volume 7f320e80-1ac4-451e-a443-39a963479ff7 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:08 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:10:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:08 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7 1073741824 Jul 03 01:10:08 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:09 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7 1073741824" returned: 0 in 1.264s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:09 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7 Jul 03 01:10:09 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:10 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7" returned: 0 in 1.062s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] <== create_volume: return (2401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.406s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef045499-5e75-4b54-8034-2f4444d599fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f320e80-1ac4-451e-a443-39a963479ff7', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ca29e4-e415-4e56-9239-36625b9f14a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:10 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Volume volume-7f320e80-1ac4-451e-a443-39a963479ff7 (7f320e80-1ac4-451e-a443-39a963479ff7): created successfully Jul 03 01:10:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ca29e4-e415-4e56-9239-36625b9f14a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Flow 'volume_create_manager' (afe164e1-56c5-4c64-9e60-3c5ad74495df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:10 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3cdc1309-d346-45f8-b4eb-40527a3faf22 tempest-AttachVolumeTestJSON-886997686 None] Created volume successfully. Jul 03 01:10:11 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-fbaa0c90-70fe-4e2a-8cda-70c24f98770f tempest-GroupsTest-1801432843 None] Group tempest-Group1-129291327: creating Jul 03 01:10:11 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-fbaa0c90-70fe-4e2a-8cda-70c24f98770f tempest-GroupsTest-1801432843 None] Group tempest-Group1-129291327: created successfully Jul 03 01:10:11 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-fbaa0c90-70fe-4e2a-8cda-70c24f98770f tempest-GroupsTest-1801432843 None] Create group completed successfully. Jul 03 01:10:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e75c3ec8-6d0e-43ea-82c8-d313e367f4a2 tempest-GroupsTest-1801432843 None] Group tempest-Group2-1997537738: creating Jul 03 01:10:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e75c3ec8-6d0e-43ea-82c8-d313e367f4a2 tempest-GroupsTest-1801432843 None] Group tempest-Group2-1997537738: created successfully Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Flow 'volume_create_manager' (84079975-ab57-4153-bf60-11a66c24c27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb67fc4-783f-4cc1-88ef-32247d8ec229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e75c3ec8-6d0e-43ea-82c8-d313e367f4a2 tempest-GroupsTest-1801432843 None] Create group completed successfully. Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb67fc4-783f-4cc1-88ef-32247d8ec229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1141031223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5148a81-2d64-4065-bbe5-92f3c53184c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d26ef7289e74ef8ab1856867f2c36a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:13Z,use_quota=True,user_id='f1773e2e4b804a07b2647d38d0ef8674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f6b23e-24c3-4dbe-befe-36e3eb924d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f6b23e-24c3-4dbe-befe-36e3eb924d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e469d9-e6f0-49c9-bd03-182fba35808a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e469d9-e6f0-49c9-bd03-182fba35808a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5148a81-2d64-4065-bbe5-92f3c53184c6', 'volume_name': 'volume-e5148a81-2d64-4065-bbe5-92f3c53184c6', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd0873c-49da-4d87-8cd2-48e5eafc6a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd0873c-49da-4d87-8cd2-48e5eafc6a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81620ac7-1016-4cb2-b189-4a2d35b6c326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:13 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Volume e5148a81-2d64-4065-bbe5-92f3c53184c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5148a81-2d64-4065-bbe5-92f3c53184c6', 'volume_size': 1} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1141031223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5148a81-2d64-4065-bbe5-92f3c53184c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d26ef7289e74ef8ab1856867f2c36a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:13Z,use_quota=True,user_id='f1773e2e4b804a07b2647d38d0ef8674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Creating volume e5148a81-2d64-4065-bbe5-92f3c53184c6 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:13 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:10:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e5148a81-2d64-4065-bbe5-92f3c53184c6 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:13 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e5148a81-2d64-4065-bbe5-92f3c53184c6 1073741824 Jul 03 01:10:13 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:14 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e5148a81-2d64-4065-bbe5-92f3c53184c6 1073741824" returned: 0 in 1.180s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e5148a81-2d64-4065-bbe5-92f3c53184c6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:14 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e5148a81-2d64-4065-bbe5-92f3c53184c6 Jul 03 01:10:14 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Flow 'volume_create_manager' (f67259d0-648d-4cd5-bc4c-9d78f59f502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0735cb9b-4f2b-4bdf-81b4-68150e0e3f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0735cb9b-4f2b-4bdf-81b4-68150e0e3f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1688361831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c8826d4-11eb-4a8c-acfa-9e1e0e645a4d,host='devstack@QuobyteHD#QuobyteHD',id=a5f793b4-2def-4fc1-a46d-031d0f9ff4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9debc7f6104aa5872559f6940a4978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:15Z,use_quota=True,user_id='548f9893afaf4af19721327f9cad1d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fa2bfa6-547b-43ba-ae93-9905b1cb7fde),volume_type_id=5fa2bfa6-547b-43ba-ae93-9905b1cb7fde)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6923f577-d29d-4c0e-a1ca-e988682f20ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6923f577-d29d-4c0e-a1ca-e988682f20ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a1cb18-cb41-47c2-b4c5-6b52fa85eb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a1cb18-cb41-47c2-b4c5-6b52fa85eb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f793b4-2def-4fc1-a46d-031d0f9ff4b0', 'volume_name': 'volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38468405-79ad-47bc-9629-061302cf7bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38468405-79ad-47bc-9629-061302cf7bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db22ec9-d15b-4e7f-af41-138c0a5a40a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:15 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Volume a5f793b4-2def-4fc1-a46d-031d0f9ff4b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0', 'volume_size': 1} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-4d699de0-be71-440f-833f-23f4e159124d req-ff96d93a-3ab8-46d6-86c5-464c95a978ad tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:15 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e5148a81-2d64-4065-bbe5-92f3c53184c6" returned: 0 in 1.437s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] <== create_volume: return (2710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.714s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.432s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2c8826d4-11eb-4a8c-acfa-9e1e0e645a4d,created_at=2026-07-02T23:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1688361831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c8826d4-11eb-4a8c-acfa-9e1e0e645a4d,host='devstack@QuobyteHD#QuobyteHD',id=a5f793b4-2def-4fc1-a46d-031d0f9ff4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9debc7f6104aa5872559f6940a4978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:15Z,use_quota=True,user_id='548f9893afaf4af19721327f9cad1d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fa2bfa6-547b-43ba-ae93-9905b1cb7fde),volume_type_id=5fa2bfa6-547b-43ba-ae93-9905b1cb7fde)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Creating volume a5f793b4-2def-4fc1-a46d-031d0f9ff4b0 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:15 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:10:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:15 devstack sudo[92281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0 1073741824 Jul 03 01:10:15 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81620ac7-1016-4cb2-b189-4a2d35b6c326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5148a81-2d64-4065-bbe5-92f3c53184c6', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d7dbcd-fc00-495d-a8c6-d3a346aff516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:16 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Volume volume-e5148a81-2d64-4065-bbe5-92f3c53184c6 (e5148a81-2d64-4065-bbe5-92f3c53184c6): created successfully Jul 03 01:10:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d7dbcd-fc00-495d-a8c6-d3a346aff516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Flow 'volume_create_manager' (84079975-ab57-4153-bf60-11a66c24c27e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-db0ab75d-21ee-4855-831d-4c8425f955ce tempest-VolumeQuotasAdminTestJSON-1364225782 None] Created volume successfully. Jul 03 01:10:17 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0 1073741824" returned: 0 in 1.275s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Acquiring lock "cinder-e5148a81-2d64-4065-bbe5-92f3c53184c6-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:17 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0 Jul 03 01:10:17 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "cinder-e5148a81-2d64-4065-bbe5-92f3c53184c6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Acquiring lock "cinder-quobyte-e5148a81-2d64-4065-bbe5-92f3c53184c6" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "cinder-quobyte-e5148a81-2d64-4065-bbe5-92f3c53184c6" acquired by "delete_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[af035ff2-0d93-4c27-ad55-0f487b1a1063]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e5148a81-2d64-4065-bbe5-92f3c53184c6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:17 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e5148a81-2d64-4065-bbe5-92f3c53184c6 Jul 03 01:10:17 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:17 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0" returned: 0 in 0.719s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-4d699de0-be71-440f-833f-23f4e159124d req-ff96d93a-3ab8-46d6-86c5-464c95a978ad tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.485s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adb37b6-215f-46be-8e41-4fcd12697fae]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-4d699de0-be71-440f-833f-23f4e159124d req-ff96d93a-3ab8-46d6-86c5-464c95a978ad tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db22ec9-d15b-4e7f-af41-138c0a5a40a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:18 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7 Jul 03 01:10:18 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb4fb83-4ef9-4e3c-a8ea-fc66611b48e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:18 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Volume volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0 (a5f793b4-2def-4fc1-a46d-031d0f9ff4b0): created successfully Jul 03 01:10:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb4fb83-4ef9-4e3c-a8ea-fc66611b48e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Flow 'volume_create_manager' (f67259d0-648d-4cd5-bc4c-9d78f59f502b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:18 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d30b04c3-44a3-45a7-83a9-0d09b289ff47 tempest-GroupsTest-1801432843 None] Created volume successfully. Jul 03 01:10:18 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e5148a81-2d64-4065-bbe5-92f3c53184c6" returned: 0 in 0.836s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e5148a81-2d64-4065-bbe5-92f3c53184c6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:18 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e5148a81-2d64-4065-bbe5-92f3c53184c6 Jul 03 01:10:18 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:18 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-4d699de0-be71-440f-833f-23f4e159124d req-ff96d93a-3ab8-46d6-86c5-464c95a978ad tempest-AttachVolumeTestJSON-886997686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7" returned: 0 in 0.842s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-4d699de0-be71-440f-833f-23f4e159124d req-ff96d93a-3ab8-46d6-86c5-464c95a978ad tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.864s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-4d699de0-be71-440f-833f-23f4e159124d req-ff96d93a-3ab8-46d6-86c5-464c95a978ad tempest-AttachVolumeTestJSON-886997686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-7f320e80-1ac4-451e-a443-39a963479ff7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0767ce3e-ec9e-4ac9-aae5-ebd21c8d6700', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:10:18 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e5148a81-2d64-4065-bbe5-92f3c53184c6" returned: 0 in 0.719s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "cinder-quobyte-e5148a81-2d64-4065-bbe5-92f3c53184c6" released by "delete_volume" :: held 1.623s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:18 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-4d699de0-be71-440f-833f-23f4e159124d req-ff96d93a-3ab8-46d6-86c5-464c95a978ad tempest-AttachVolumeTestJSON-886997686 None] attachment_update completed successfully. Jul 03 01:10:19 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Created reservations ['bac80241-d695-45ef-b2ac-3be874566a30', '00ec43ec-e4a1-480a-af6b-e5da345dbe32', 'e0eec479-240a-4a23-b197-ff3e22e9ced4', 'f287c53b-f8b8-4a73-a627-3541e5adbe71'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:19 devstack sudo[92354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:10:19 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Acquiring lock "cinder-quobyte-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Lock "cinder-quobyte-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:19 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[741b210a-a162-493d-8e9c-d599421066fd]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:19 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0 Jul 03 01:10:19 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:20 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.907s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:20 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Deleted volume successfully. Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3384f1b4-08d4-4e05-9714-5e0ac2847819 tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "cinder-e5148a81-2d64-4065-bbe5-92f3c53184c6-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Flow 'volume_create_manager' (29856faf-573b-4b18-9684-d1abe8eb33c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1fdab8a-1345-4094-b621-8a80a8ee57fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1fdab8a-1345-4094-b621-8a80a8ee57fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1469656289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847e9d30-2f74-4389-90cb-07bbbe18d22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d26ef7289e74ef8ab1856867f2c36a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:20Z,use_quota=True,user_id='f1773e2e4b804a07b2647d38d0ef8674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22166602-e7ec-4ab8-965e-5416ec65b21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22166602-e7ec-4ab8-965e-5416ec65b21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b09dee-3292-4005-8b9c-e0d1b5369faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b09dee-3292-4005-8b9c-e0d1b5369faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '847e9d30-2f74-4389-90cb-07bbbe18d22c', 'volume_name': 'volume-847e9d30-2f74-4389-90cb-07bbbe18d22c', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cde106e-0b76-4bce-a026-8dae405f53c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cde106e-0b76-4bce-a026-8dae405f53c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d8335b4-d188-49d6-8ba8-8f4a991c645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:20 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Volume 847e9d30-2f74-4389-90cb-07bbbe18d22c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-847e9d30-2f74-4389-90cb-07bbbe18d22c', 'volume_size': 1} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1469656289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847e9d30-2f74-4389-90cb-07bbbe18d22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d26ef7289e74ef8ab1856867f2c36a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:20Z,use_quota=True,user_id='f1773e2e4b804a07b2647d38d0ef8674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Creating volume 847e9d30-2f74-4389-90cb-07bbbe18d22c {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:20 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-847e9d30-2f74-4389-90cb-07bbbe18d22c 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:20 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-847e9d30-2f74-4389-90cb-07bbbe18d22c 1073741824 Jul 03 01:10:20 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:20 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0" returned: 0 in 0.993s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:20 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0 Jul 03 01:10:20 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:21 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-847e9d30-2f74-4389-90cb-07bbbe18d22c 1073741824" returned: 0 in 0.909s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-847e9d30-2f74-4389-90cb-07bbbe18d22c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:21 devstack sudo[92378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-847e9d30-2f74-4389-90cb-07bbbe18d22c Jul 03 01:10:21 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:21 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0" returned: 0 in 0.676s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Lock "cinder-quobyte-a5f793b4-2def-4fc1-a46d-031d0f9ff4b0" released by "delete_volume" :: held 1.746s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:21 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Created reservations ['1765f569-4ee8-41c2-bbfe-0e7a8602bacb'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:21 devstack cinder-volume[86357]: WARNING cinder.quota [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1824704014 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1824704014, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:10:21 devstack cinder-volume[86357]: WARNING cinder.quota [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1824704014 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1824704014, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:10:21 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Created reservations ['43c0049d-a273-4033-81b2-b220152af973', '09ec91d0-2e9f-4520-a72a-f729d3d3fb00', '6a6d4ceb-4a7f-48bf-aef9-ca9046c54e5a', 'f4b2a5e0-c6c1-4985-b537-ef9718d8c56a'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:21 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:10:21 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:22 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-847e9d30-2f74-4389-90cb-07bbbe18d22c" returned: 0 in 0.841s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d8335b4-d188-49d6-8ba8-8f4a991c645a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-847e9d30-2f74-4389-90cb-07bbbe18d22c', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106bf96e-dbcd-4fed-bf67-a1f5ff21bfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:22 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Volume volume-847e9d30-2f74-4389-90cb-07bbbe18d22c (847e9d30-2f74-4389-90cb-07bbbe18d22c): created successfully Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106bf96e-dbcd-4fed-bf67-a1f5ff21bfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Flow 'volume_create_manager' (29856faf-573b-4b18-9684-d1abe8eb33c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:22 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ae6e4d63-7bef-4e46-83b7-8fceb87cdd2d tempest-VolumeQuotasAdminTestJSON-1364225782 None] Created volume successfully. Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-11081f48-0fe1-443c-be06-a87ebf94a7b0 tempest-GroupsTest-1801432843 None] Created reservations ['f7e4faaf-c08d-45bd-b08c-5b63ad370615'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-11081f48-0fe1-443c-be06-a87ebf94a7b0 tempest-GroupsTest-1801432843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-11081f48-0fe1-443c-be06-a87ebf94a7b0 tempest-GroupsTest-1801432843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-11081f48-0fe1-443c-be06-a87ebf94a7b0 tempest-GroupsTest-1801432843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-11081f48-0fe1-443c-be06-a87ebf94a7b0 tempest-GroupsTest-1801432843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-11081f48-0fe1-443c-be06-a87ebf94a7b0 tempest-GroupsTest-1801432843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-11081f48-0fe1-443c-be06-a87ebf94a7b0 tempest-GroupsTest-1801432843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:22 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:10:22 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:22 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.082s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:22 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:22 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-00ce1479-fa9d-4d0f-9042-5922f7759db0 tempest-GroupsTest-1801432843 None] Delete group completed successfully. Jul 03 01:10:23 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-11081f48-0fe1-443c-be06-a87ebf94a7b0 tempest-GroupsTest-1801432843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.939s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:23 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-11081f48-0fe1-443c-be06-a87ebf94a7b0 tempest-GroupsTest-1801432843 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:23 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-11081f48-0fe1-443c-be06-a87ebf94a7b0 tempest-GroupsTest-1801432843 None] Delete group completed successfully. Jul 03 01:10:24 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3f93651a-9202-4bb4-b2ab-a609b855f05a tempest-GroupsTest-1801432843 None] Group tempest-GroupsTest-Group-1213672702: creating Jul 03 01:10:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3f93651a-9202-4bb4-b2ab-a609b855f05a tempest-GroupsTest-1801432843 None] Group tempest-GroupsTest-Group-1213672702: created successfully Jul 03 01:10:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3f93651a-9202-4bb4-b2ab-a609b855f05a tempest-GroupsTest-1801432843 None] Create group completed successfully. Jul 03 01:10:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1adcf15e-66f4-419c-9737-627473da36fa tempest-VolumeQuotasAdminTestJSON-918644853 None] Transfer volume completed successfully. Jul 03 01:10:25 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Flow 'volume_create_manager' (b66629e4-5f36-49e7-ab8f-5eecb382787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b506622-a676-4896-bde2-2614d7dae78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b506622-a676-4896-bde2-2614d7dae78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1544043918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2a19906-6bad-4f35-9871-ca1e9879862d,host='devstack@QuobyteHD#QuobyteHD',id=49e0d8f2-29d0-458f-aab9-98d0b78002ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9debc7f6104aa5872559f6940a4978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:26Z,use_quota=True,user_id='548f9893afaf4af19721327f9cad1d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14c81e45-bf8d-4aa7-95ad-c8900827b23b),volume_type_id=14c81e45-bf8d-4aa7-95ad-c8900827b23b)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830c19a8-6c5b-4190-8032-f1be1bc0c962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830c19a8-6c5b-4190-8032-f1be1bc0c962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bdd3510-4568-4361-ac18-400acbb0590f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bdd3510-4568-4361-ac18-400acbb0590f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e0d8f2-29d0-458f-aab9-98d0b78002ba', 'volume_name': 'volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c8e340-875d-44bf-b2b6-feaf9065e75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c8e340-875d-44bf-b2b6-feaf9065e75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25617c1-3e65-48c6-b5e2-63184656572f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:26 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Volume 49e0d8f2-29d0-458f-aab9-98d0b78002ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba', 'volume_size': 1} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2a19906-6bad-4f35-9871-ca1e9879862d,created_at=2026-07-02T23:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1544043918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2a19906-6bad-4f35-9871-ca1e9879862d,host='devstack@QuobyteHD#QuobyteHD',id=49e0d8f2-29d0-458f-aab9-98d0b78002ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9debc7f6104aa5872559f6940a4978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:26Z,use_quota=True,user_id='548f9893afaf4af19721327f9cad1d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14c81e45-bf8d-4aa7-95ad-c8900827b23b),volume_type_id=14c81e45-bf8d-4aa7-95ad-c8900827b23b)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Creating volume 49e0d8f2-29d0-458f-aab9-98d0b78002ba {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:26 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:26 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba 1073741824 Jul 03 01:10:26 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Acquiring lock "cinder-847e9d30-2f74-4389-90cb-07bbbe18d22c-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Lock "cinder-847e9d30-2f74-4389-90cb-07bbbe18d22c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:27 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-e5e6d5b6-cb00-4024-b912-ca19ea57231b req-abf66277-027b-4cec-a822-9ee31ba79aab tempest-AttachVolumeTestJSON-886997686 None] Terminate volume connection completed successfully. Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-e5e6d5b6-cb00-4024-b912-ca19ea57231b req-abf66277-027b-4cec-a822-9ee31ba79aab tempest-AttachVolumeTestJSON-886997686 None] Deleting attachment 08ee1f30-a718-48d8-b660-63732964ed49. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Acquiring lock "cinder-quobyte-847e9d30-2f74-4389-90cb-07bbbe18d22c" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Lock "cinder-quobyte-847e9d30-2f74-4389-90cb-07bbbe18d22c" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e286b0-04ad-4cc5-be41-f6a673238639]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-847e9d30-2f74-4389-90cb-07bbbe18d22c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:27 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-847e9d30-2f74-4389-90cb-07bbbe18d22c Jul 03 01:10:27 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:27 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba 1073741824" returned: 0 in 1.611s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:27 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:10:27 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:27 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba Jul 03 01:10:27 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:28 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-847e9d30-2f74-4389-90cb-07bbbe18d22c" returned: 0 in 1.654s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-847e9d30-2f74-4389-90cb-07bbbe18d22c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:28 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-847e9d30-2f74-4389-90cb-07bbbe18d22c Jul 03 01:10:28 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:28 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba" returned: 0 in 0.964s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] <== create_volume: return (2654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.656s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25617c1-3e65-48c6-b5e2-63184656572f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0a1efe-9cac-4b74-b93e-b61932694555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:28 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Volume volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba (49e0d8f2-29d0-458f-aab9-98d0b78002ba): created successfully Jul 03 01:10:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0a1efe-9cac-4b74-b93e-b61932694555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Flow 'volume_create_manager' (b66629e4-5f36-49e7-ab8f-5eecb382787f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:28 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-372a0763-f894-47d5-bfb8-b6507a16a968 tempest-GroupsTest-1801432843 None] Created volume successfully. Jul 03 01:10:29 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.198s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 8 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:10:29 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-847e9d30-2f74-4389-90cb-07bbbe18d22c" returned: 0 in 0.792s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Lock "cinder-quobyte-847e9d30-2f74-4389-90cb-07bbbe18d22c" released by "delete_volume" :: held 2.508s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Created reservations ['2518aace-c248-4037-b75c-8443bd8f628d', 'e76974f5-0c28-47c4-9edd-7296730a0023', '04f9e863-be15-4828-9617-3dfa14b98f80', '1ed9aae2-dcea-4041-9c8e-1c643e4983cf'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:29 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:10:29 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:30 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.763s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:30 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Deleted volume successfully. Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Flow 'volume_create_manager' (9fe4e992-0256-40ec-b6d3-62cb5e5aeb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38dc9a6a-67c5-4f1e-bcd2-5dde30e1c4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9987addf-b521-42d5-aeac-c466f7e84a42 tempest-VolumeQuotasAdminTestJSON-517277897 None] Lock "cinder-847e9d30-2f74-4389-90cb-07bbbe18d22c-delete_volume" released by "delete_volume" :: held 3.682s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:30 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-afe14b33-ed39-47b9-b5a9-7b00912f885e req-02856e2b-e374-4f13-ba12-acb5784caa03 tempest-AttachVolumeTestJSON-886997686 None] Terminate volume connection completed successfully. Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-afe14b33-ed39-47b9-b5a9-7b00912f885e req-02856e2b-e374-4f13-ba12-acb5784caa03 tempest-AttachVolumeTestJSON-886997686 None] Deleting attachment 0767ce3e-ec9e-4ac9-aae5-ebd21c8d6700. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38dc9a6a-67c5-4f1e-bcd2-5dde30e1c4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-850376754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2a19906-6bad-4f35-9871-ca1e9879862d,host='devstack@QuobyteHD#QuobyteHD',id=8605e910-477b-4a8b-b8e1-eb7da56a69fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9debc7f6104aa5872559f6940a4978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:31Z,use_quota=True,user_id='548f9893afaf4af19721327f9cad1d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14c81e45-bf8d-4aa7-95ad-c8900827b23b),volume_type_id=14c81e45-bf8d-4aa7-95ad-c8900827b23b)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd003db1-bb99-4290-a11c-83adef860c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd003db1-bb99-4290-a11c-83adef860c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec02c8d0-f5b5-437c-8598-c1ba3e2b7476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec02c8d0-f5b5-437c-8598-c1ba3e2b7476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8605e910-477b-4a8b-b8e1-eb7da56a69fd', 'volume_name': 'volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6885684a-484d-4721-a0fb-aea708a43659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6885684a-484d-4721-a0fb-aea708a43659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16943da-36d3-4dd8-94d9-6a7b42539b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:30 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Volume 8605e910-477b-4a8b-b8e1-eb7da56a69fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd', 'volume_size': 1} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2a19906-6bad-4f35-9871-ca1e9879862d,created_at=2026-07-02T23:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-850376754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2a19906-6bad-4f35-9871-ca1e9879862d,host='devstack@QuobyteHD#QuobyteHD',id=8605e910-477b-4a8b-b8e1-eb7da56a69fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9debc7f6104aa5872559f6940a4978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:31Z,use_quota=True,user_id='548f9893afaf4af19721327f9cad1d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14c81e45-bf8d-4aa7-95ad-c8900827b23b),volume_type_id=14c81e45-bf8d-4aa7-95ad-c8900827b23b)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Creating volume 8605e910-477b-4a8b-b8e1-eb7da56a69fd {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:30 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:10:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:30 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd 1073741824 Jul 03 01:10:30 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:31 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd 1073741824" returned: 0 in 0.939s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:31 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd Jul 03 01:10:31 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:32 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd" returned: 0 in 0.717s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16943da-36d3-4dd8-94d9-6a7b42539b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b07a7c-cf6c-4a74-9e02-e702b96da7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:32 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Volume volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd (8605e910-477b-4a8b-b8e1-eb7da56a69fd): created successfully Jul 03 01:10:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b07a7c-cf6c-4a74-9e02-e702b96da7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Flow 'volume_create_manager' (9fe4e992-0256-40ec-b6d3-62cb5e5aeb1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:32 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ff214f5a-0ce4-45e2-b15d-017e1c648bfb tempest-GroupsTest-1801432843 None] Created volume successfully. Jul 03 01:10:33 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7d7a6dcf-3b31-4af7-ad01-c9d90b592f42 tempest-GroupsTest-1801432843 None] Update group completed successfully. Jul 03 01:10:34 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=118,cinder:SELECT=111,cinder:INSERT=26,cinder:DELETE=7 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:10:34 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=120,cinder:UPDATE=121,cinder:INSERT=24,cinder:DELETE=3 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:10:34 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1ac45f5c-4f5f-412f-9b06-ddb18971eda0 tempest-GroupsTest-1801432843 None] Update group completed successfully. Jul 03 01:10:35 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Flow 'volume_create_manager' (fc8e9a4d-06bf-4457-a300-1aec2b765ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8520134a-6030-485f-9f5f-f583e2b3c532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8520134a-6030-485f-9f5f-f583e2b3c532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-290111415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b7cf7d-08a2-40db-b654-03c21e0ed400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0449ae4e0434d7481c69048c4d9db99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:36Z,use_quota=True,user_id='5cfd56d9667d4281a3ae5b63c0fa27f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cfd9c9-4c27-45d2-8028-02eaadd374c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cfd9c9-4c27-45d2-8028-02eaadd374c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef827a41-6738-4909-9e26-4fb049645056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef827a41-6738-4909-9e26-4fb049645056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0b7cf7d-08a2-40db-b654-03c21e0ed400', 'volume_name': 'volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5307c2d1-502a-4f48-8d56-6c7383ded4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5307c2d1-502a-4f48-8d56-6c7383ded4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb93fe6-9a8e-4ead-b1e4-b8ec2eef0311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:36 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Volume a0b7cf7d-08a2-40db-b654-03c21e0ed400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400', 'volume_size': 1} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-290111415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b7cf7d-08a2-40db-b654-03c21e0ed400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0449ae4e0434d7481c69048c4d9db99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:36Z,use_quota=True,user_id='5cfd56d9667d4281a3ae5b63c0fa27f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Creating volume a0b7cf7d-08a2-40db-b654-03c21e0ed400 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:36 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:36 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400 1073741824 Jul 03 01:10:36 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Acquiring lock "cinder-quobyte-49e0d8f2-29d0-458f-aab9-98d0b78002ba" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Lock "cinder-quobyte-49e0d8f2-29d0-458f-aab9-98d0b78002ba" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff84d152-aace-40c9-8845-372c852f167e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:37 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba Jul 03 01:10:37 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:37 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400 1073741824" returned: 0 in 1.127s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:37 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400 Jul 03 01:10:37 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:37 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba" returned: 0 in 0.852s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:37 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba Jul 03 01:10:37 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:38 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400" returned: 0 in 0.761s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb93fe6-9a8e-4ead-b1e4-b8ec2eef0311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074ead48-929e-4a05-9a7b-4efd492a4ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:38 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Volume volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400 (a0b7cf7d-08a2-40db-b654-03c21e0ed400): created successfully Jul 03 01:10:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074ead48-929e-4a05-9a7b-4efd492a4ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Flow 'volume_create_manager' (fc8e9a4d-06bf-4457-a300-1aec2b765ccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:38 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-56149a06-bbd2-47a8-9fa0-e7d8d4a0bdd2 tempest-ServersNegativeTestJSON-866412825 None] Created volume successfully. Jul 03 01:10:38 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-49e0d8f2-29d0-458f-aab9-98d0b78002ba" returned: 0 in 0.780s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Lock "cinder-quobyte-49e0d8f2-29d0-458f-aab9-98d0b78002ba" released by "delete_volume" :: held 1.719s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Acquiring lock "cinder-quobyte-8605e910-477b-4a8b-b8e1-eb7da56a69fd" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Lock "cinder-quobyte-8605e910-477b-4a8b-b8e1-eb7da56a69fd" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:38 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0f579c-d57c-45a4-9d26-eb7e6a8ff2ef]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:38 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd Jul 03 01:10:38 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Flow 'volume_create_manager' (c48cdd08-6a18-45a8-b4cf-3d40b33a6e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd91ca2-771b-496d-9f2e-4919e8eaa14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd91ca2-771b-496d-9f2e-4919e8eaa14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2083508788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e1ae94-8902-4fa7-a0c3-a152298a01bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d6730d1d9342ac9894fbf16b5fb303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:39Z,use_quota=True,user_id='b5e56be95df4483692f9bce89f96433a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e48d1a-ac1b-4205-8190-b5d8e4fd3a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e48d1a-ac1b-4205-8190-b5d8e4fd3a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe0ab87-660a-4f03-826a-fe6e3856ffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe0ab87-660a-4f03-826a-fe6e3856ffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e1ae94-8902-4fa7-a0c3-a152298a01bc', 'volume_name': 'volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823ffb90-eb30-4b04-9028-03248a994877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823ffb90-eb30-4b04-9028-03248a994877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61943b18-3582-467c-b69b-bfbaf17a4be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:39 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Volume 80e1ae94-8902-4fa7-a0c3-a152298a01bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc', 'volume_size': 1} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2083508788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e1ae94-8902-4fa7-a0c3-a152298a01bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d6730d1d9342ac9894fbf16b5fb303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:39Z,use_quota=True,user_id='b5e56be95df4483692f9bce89f96433a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Creating volume 80e1ae94-8902-4fa7-a0c3-a152298a01bc {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:39 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:39 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc 1073741824 Jul 03 01:10:39 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:39 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd" returned: 0 in 0.880s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:39 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd Jul 03 01:10:39 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:40 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8605e910-477b-4a8b-b8e1-eb7da56a69fd" returned: 0 in 0.726s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:40 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Lock "cinder-quobyte-8605e910-477b-4a8b-b8e1-eb7da56a69fd" released by "delete_volume" :: held 1.656s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc 1073741824" returned: 0 in 1.072s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:40 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc Jul 03 01:10:40 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Created reservations ['eafa822d-6cce-4f39-9bfd-c3bcc87ce813'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:40 devstack cinder-volume[86357]: WARNING cinder.quota [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1653910599 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1653910599, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:10:40 devstack cinder-volume[86357]: WARNING cinder.quota [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1653910599 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1653910599, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Created reservations ['e09b0cc0-9179-4e1e-86e4-f80c86f65910', '85dbe011-a0d1-42ab-bd0d-bef9c63c37a8', '9aa323cc-808f-453c-ae63-814460a4f9da', 'd2be5451-e84f-484a-914a-10d8cf4b0520'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Created reservations ['d3de6f02-4f20-48d1-bbca-4418b0cf96f9', '1678bb0e-d406-46d6-8f3a-ba8f4d00c2b7', '959742d5-0f15-41f8-b939-a18aaf4a8aac', 'f83ba736-0cad-410d-aba5-d1d2bb66c7fa'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:40 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:10:40 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Flow 'volume_create_manager' (ce0448a6-c03d-40d7-be9a-a3ff8c0eb565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e390d42c-44dc-4d9f-a4e6-ea4cd4235bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e390d42c-44dc-4d9f-a4e6-ea4cd4235bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-336215229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c81064-fc2c-4b92-b3f2-cb16dbf46519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0449ae4e0434d7481c69048c4d9db99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:41Z,use_quota=True,user_id='5cfd56d9667d4281a3ae5b63c0fa27f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f37b7a-23b1-43f8-bbf6-066de138783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f37b7a-23b1-43f8-bbf6-066de138783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03479250-7d4e-426f-bc71-f28b6c2e595a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03479250-7d4e-426f-bc71-f28b6c2e595a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c81064-fc2c-4b92-b3f2-cb16dbf46519', 'volume_name': 'volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997ea847-950d-45b3-b8f2-19cbd9f8f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997ea847-950d-45b3-b8f2-19cbd9f8f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736f6ccc-1aa1-418a-83f9-f807e325e04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:40 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Volume b5c81064-fc2c-4b92-b3f2-cb16dbf46519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519', 'volume_size': 1} Jul 03 01:10:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:41 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc" returned: 0 in 0.731s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.187s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-336215229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c81064-fc2c-4b92-b3f2-cb16dbf46519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0449ae4e0434d7481c69048c4d9db99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:41Z,use_quota=True,user_id='5cfd56d9667d4281a3ae5b63c0fa27f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Creating volume b5c81064-fc2c-4b92-b3f2-cb16dbf46519 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:41 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:41 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519 1073741824 Jul 03 01:10:41 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61943b18-3582-467c-b69b-bfbaf17a4be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6154b28c-ff57-40cc-8ac8-487e4fa78f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:41 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Volume volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc (80e1ae94-8902-4fa7-a0c3-a152298a01bc): created successfully Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6154b28c-ff57-40cc-8ac8-487e4fa78f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Flow 'volume_create_manager' (c48cdd08-6a18-45a8-b4cf-3d40b33a6e3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:41 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7c9216b3-af57-4a18-a47c-96bd741470b3 tempest-VolumesServicesTestJSON-1580911170 None] Created volume successfully. Jul 03 01:10:41 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.901s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:41 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:41 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c74b87df-2415-4ce2-aaea-8f6e385a4b69 tempest-GroupsTest-1801432843 None] Delete group completed successfully. Jul 03 01:10:42 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519 1073741824" returned: 0 in 0.984s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:42 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519 Jul 03 01:10:42 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Acquiring lock "cinder-80e1ae94-8902-4fa7-a0c3-a152298a01bc-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Lock "cinder-80e1ae94-8902-4fa7-a0c3-a152298a01bc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Acquiring lock "cinder-quobyte-80e1ae94-8902-4fa7-a0c3-a152298a01bc" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Lock "cinder-quobyte-80e1ae94-8902-4fa7-a0c3-a152298a01bc" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:42 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[252bf85d-de29-4368-9ffb-0d43267da44d]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:42 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc Jul 03 01:10:42 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:42 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519" returned: 0 in 0.853s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736f6ccc-1aa1-418a-83f9-f807e325e04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6459468-e995-4694-a02b-4fe1c83c6141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:42 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Volume volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519 (b5c81064-fc2c-4b92-b3f2-cb16dbf46519): created successfully Jul 03 01:10:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6459468-e995-4694-a02b-4fe1c83c6141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Flow 'volume_create_manager' (ce0448a6-c03d-40d7-be9a-a3ff8c0eb565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:43 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-95a04ce4-09ea-4b00-b706-49d1a6533a8c tempest-ServersNegativeTestJSON-866412825 None] Created volume successfully. Jul 03 01:10:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "cinder-7f320e80-1ac4-451e-a443-39a963479ff7-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Lock "cinder-7f320e80-1ac4-451e-a443-39a963479ff7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "cinder-quobyte-7f320e80-1ac4-451e-a443-39a963479ff7" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Lock "cinder-quobyte-7f320e80-1ac4-451e-a443-39a963479ff7" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:43 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b8afdc-a482-4a8c-a749-2b8320c4b69c]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:43 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7 Jul 03 01:10:43 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:43 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc" returned: 0 in 0.934s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:43 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc Jul 03 01:10:43 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:44 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7" returned: 0 in 0.934s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:44 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7 Jul 03 01:10:44 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:44 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-80e1ae94-8902-4fa7-a0c3-a152298a01bc" returned: 0 in 0.830s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Lock "cinder-quobyte-80e1ae94-8902-4fa7-a0c3-a152298a01bc" released by "delete_volume" :: held 1.848s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Created reservations ['1bf9e108-8142-47ee-b611-c53e80940ab6', '6b6cae95-d2c8-427b-a2ad-4da53ecc120b', '974a7c58-1017-4c35-bde6-96f981b27f89', '4e15b4b9-7012-4858-8615-51a7cffa581f'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Acquiring lock "cinder-b5c81064-fc2c-4b92-b3f2-cb16dbf46519-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Lock "cinder-b5c81064-fc2c-4b92-b3f2-cb16dbf46519-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:44 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:10:44 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Acquiring lock "cinder-quobyte-b5c81064-fc2c-4b92-b3f2-cb16dbf46519" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Lock "cinder-quobyte-b5c81064-fc2c-4b92-b3f2-cb16dbf46519" acquired by "delete_volume" :: waited 0.030s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[b757f05f-df7f-4bd6-b74b-04cf78fb1abe]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:45 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519 Jul 03 01:10:45 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:45 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7f320e80-1ac4-451e-a443-39a963479ff7" returned: 0 in 0.949s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Lock "cinder-quobyte-7f320e80-1ac4-451e-a443-39a963479ff7" released by "delete_volume" :: held 1.938s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Created reservations ['2bd9acff-00da-41b9-89bf-e344a6d0d8e2', '4a04008f-1181-4b95-b3ca-2cc5b239b54f', 'e0f4b971-7aeb-481d-9d5b-fdf33e4b911a', '9a077aae-c820-4434-ac02-eaf82dae6b6e'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:45 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:10:45 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "cinder-20719bac-75c5-44bd-99ec-8eb69c87e4a8-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Lock "cinder-20719bac-75c5-44bd-99ec-8eb69c87e4a8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "cinder-quobyte-20719bac-75c5-44bd-99ec-8eb69c87e4a8" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Lock "cinder-quobyte-20719bac-75c5-44bd-99ec-8eb69c87e4a8" acquired by "delete_volume" :: waited 0.035s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73991aa-9288-4b87-856c-9a3b197ac44c]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:45 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8 Jul 03 01:10:45 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:46 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.301s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:46 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:46 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Deleted volume successfully. Jul 03 01:10:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2d57e6fb-9f4f-415c-aeaa-7d3381793ced tempest-VolumesServicesTestJSON-1580911170 None] Lock "cinder-80e1ae94-8902-4fa7-a0c3-a152298a01bc-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:46 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519" returned: 0 in 1.242s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:46 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519 Jul 03 01:10:46 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:46 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.251s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:46 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:46 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Deleted volume successfully. Jul 03 01:10:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ad0f87bf-67e3-47a1-baa4-d97a344559c6 tempest-AttachVolumeTestJSON-886997686 None] Lock "cinder-7f320e80-1ac4-451e-a443-39a963479ff7-delete_volume" released by "delete_volume" :: held 3.558s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:46 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8" returned: 0 in 0.997s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:46 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8 Jul 03 01:10:46 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:46 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b5c81064-fc2c-4b92-b3f2-cb16dbf46519" returned: 0 in 0.827s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Lock "cinder-quobyte-b5c81064-fc2c-4b92-b3f2-cb16dbf46519" released by "delete_volume" :: held 2.140s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:47 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Created reservations ['992291d5-60ad-47cf-885f-3be15acfcd61', 'aacee19a-5610-4f98-986a-d34e80b28136', 'f2ac0643-db4d-4157-b257-d27f91b7474b', '01cacce8-bf79-49c5-bb90-c9d99396eec6'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:47 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:10:47 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:47 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-20719bac-75c5-44bd-99ec-8eb69c87e4a8" returned: 0 in 1.075s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Lock "cinder-quobyte-20719bac-75c5-44bd-99ec-8eb69c87e4a8" released by "delete_volume" :: held 2.143s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:47 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Created reservations ['2ace527b-b41a-4ef7-8c9c-b242c1bf29d7', 'bcc1c83d-dd4c-4004-9ff2-85aa7f78b533', '95bc4e18-c5a9-44f9-bdd4-deb69d993ebc', '1e142d3e-e338-48fa-977a-c818cd17ee91'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:48 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Acquiring lock "cinder-a0b7cf7d-08a2-40db-b654-03c21e0ed400-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:48 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Lock "cinder-a0b7cf7d-08a2-40db-b654-03c21e0ed400-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:48 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.155s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Acquiring lock "cinder-quobyte-a0b7cf7d-08a2-40db-b654-03c21e0ed400" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:48 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Deleted volume successfully. Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d81fb7f6-9ec7-4db1-8f3d-cc1c14c3dfe7 tempest-ServersNegativeTestJSON-866412825 None] Lock "cinder-b5c81064-fc2c-4b92-b3f2-cb16dbf46519-delete_volume" released by "delete_volume" :: held 3.674s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Lock "cinder-quobyte-a0b7cf7d-08a2-40db-b654-03c21e0ed400" acquired by "delete_volume" :: waited 0.038s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6273e5-43c6-4b85-bba3-1afa1d49cdd8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:48 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400 Jul 03 01:10:48 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:48 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.780s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:48 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:48 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Deleted volume successfully. Jul 03 01:10:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f8d794d9-dee2-4956-a32c-719b81b23c2e tempest-AttachVolumeTestJSON-886997686 None] Lock "cinder-20719bac-75c5-44bd-99ec-8eb69c87e4a8-delete_volume" released by "delete_volume" :: held 3.462s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "cinder-b3d43c6e-2089-48e7-9fb7-10a1af6607d6-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Lock "cinder-b3d43c6e-2089-48e7-9fb7-10a1af6607d6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "cinder-quobyte-b3d43c6e-2089-48e7-9fb7-10a1af6607d6" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Lock "cinder-quobyte-b3d43c6e-2089-48e7-9fb7-10a1af6607d6" acquired by "delete_volume" :: waited 0.050s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:49 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[862c252b-2654-456b-9af8-88181313e65f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:49 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400" returned: 0 in 1.100s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:49 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400 Jul 03 01:10:49 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:49 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6 Jul 03 01:10:49 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:50 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-60f3ff74-2b52-45b7-b97d-0dc8cfb993b3 tempest-GroupsV314Test-743155 None] Group tempest-GroupsV314Test-Group-1773663965: creating Jul 03 01:10:50 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-60f3ff74-2b52-45b7-b97d-0dc8cfb993b3 tempest-GroupsV314Test-743155 None] Group tempest-GroupsV314Test-Group-1773663965: created successfully Jul 03 01:10:50 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-60f3ff74-2b52-45b7-b97d-0dc8cfb993b3 tempest-GroupsV314Test-743155 None] Create group completed successfully. Jul 03 01:10:50 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0b7cf7d-08a2-40db-b654-03c21e0ed400" returned: 0 in 0.844s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Lock "cinder-quobyte-a0b7cf7d-08a2-40db-b654-03c21e0ed400" released by "delete_volume" :: held 2.022s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:50 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6" returned: 0 in 0.974s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:50 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Created reservations ['8ef312dc-41ed-4852-8b98-08f8920dd5a6', 'd4383470-eeac-46c8-898b-4671a5fd2097', 'd1b770b1-5477-4479-a7ee-6a16cfef7d96', 'aa87c7de-5bb3-45e5-a3b4-7a30f9d101cf'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:50 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6 Jul 03 01:10:50 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:50 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:50 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:50 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:10:50 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:51 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3d43c6e-2089-48e7-9fb7-10a1af6607d6" returned: 0 in 0.763s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Lock "cinder-quobyte-b3d43c6e-2089-48e7-9fb7-10a1af6607d6" released by "delete_volume" :: held 1.851s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:51 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Created reservations ['37901c7f-86a1-437a-9288-ec708c964b36', '00ccca8d-5df7-4946-8f32-ba6f312cb156', '225607f0-a724-4591-8667-c939848a3d6c', '04ecae89-d2dc-41de-85d6-018eb676404d'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:51 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.726s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:51 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:51 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Deleted volume successfully. Jul 03 01:10:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-58877386-0c0b-4dfc-991f-3614fddc3326 tempest-ServersNegativeTestJSON-866412825 None] Lock "cinder-a0b7cf7d-08a2-40db-b654-03c21e0ed400-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:51 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:10:51 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Flow 'volume_create_manager' (46a04d98-7736-4fb5-9177-6fe17509a9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a31fdc9-e4c7-4889-857d-775f6dab5a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a31fdc9-e4c7-4889-857d-775f6dab5a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1586661664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=164b1878-f821-4c89-adcf-07db572592aa,host='devstack@QuobyteHD#QuobyteHD',id=2b58124e-ef0c-48de-906b-40f08aa73d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28354252a8e46818d435df9ffbbafb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:52Z,use_quota=True,user_id='768f2fa0342d467b8144de6ab4ad59c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccd7fee3-1477-41ae-86f8-e007448de50a),volume_type_id=ccd7fee3-1477-41ae-86f8-e007448de50a)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54acd76d-ccbc-4927-bc91-2031afa9fba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54acd76d-ccbc-4927-bc91-2031afa9fba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a70a5e1-d6cf-4243-8f1c-2bd8d0ea0114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a70a5e1-d6cf-4243-8f1c-2bd8d0ea0114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b58124e-ef0c-48de-906b-40f08aa73d0b', 'volume_name': 'volume-2b58124e-ef0c-48de-906b-40f08aa73d0b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89ea7de-bbc5-44de-86b5-de76e4eaa999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89ea7de-bbc5-44de-86b5-de76e4eaa999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec44600-94d1-4099-b00e-53ce3570665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:52 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Volume 2b58124e-ef0c-48de-906b-40f08aa73d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b58124e-ef0c-48de-906b-40f08aa73d0b', 'volume_size': 1} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=164b1878-f821-4c89-adcf-07db572592aa,created_at=2026-07-02T23:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1586661664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=164b1878-f821-4c89-adcf-07db572592aa,host='devstack@QuobyteHD#QuobyteHD',id=2b58124e-ef0c-48de-906b-40f08aa73d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28354252a8e46818d435df9ffbbafb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:52Z,use_quota=True,user_id='768f2fa0342d467b8144de6ab4ad59c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccd7fee3-1477-41ae-86f8-e007448de50a),volume_type_id=ccd7fee3-1477-41ae-86f8-e007448de50a)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Creating volume 2b58124e-ef0c-48de-906b-40f08aa73d0b {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:52 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:52 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b 1073741824 Jul 03 01:10:52 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:52 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.038s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:52 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Deleted volume successfully. Jul 03 01:10:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-09f9ef67-72d8-4938-ac15-67b6881d99cc tempest-AttachVolumeTestJSON-886997686 None] Lock "cinder-b3d43c6e-2089-48e7-9fb7-10a1af6607d6-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:53 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b 1073741824" returned: 0 in 1.291s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:53 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b Jul 03 01:10:53 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:54 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b" returned: 0 in 0.924s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec44600-94d1-4099-b00e-53ce3570665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b58124e-ef0c-48de-906b-40f08aa73d0b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24152a53-6a41-4099-9ae3-e24530d617b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:54 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Volume volume-2b58124e-ef0c-48de-906b-40f08aa73d0b (2b58124e-ef0c-48de-906b-40f08aa73d0b): created successfully Jul 03 01:10:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24152a53-6a41-4099-9ae3-e24530d617b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Flow 'volume_create_manager' (46a04d98-7736-4fb5-9177-6fe17509a9da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:54 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c4b29de8-7ecb-42bd-aecd-40791bda2048 tempest-GroupsV314Test-743155 None] Created volume successfully. Jul 03 01:10:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:57 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Cloning volume 2b58124e-ef0c-48de-906b-40f08aa73d0b to volume 971f213c-1aa0-4e1c-84ec-b2680584d848 Jul 03 01:10:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Creating offline snapshot 394867e0-4abd-4e90-8c6b-bb5ce71261bd of volume 2b58124e-ef0c-48de-906b-40f08aa73d0b {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:10:57 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d67694-b8ce-426c-838f-ed7adca5c4cd]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:57 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b Jul 03 01:10:57 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:58 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b" returned: 0 in 1.011s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:58 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd 1G Jul 03 01:10:58 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:59 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd 1G" returned: 0 in 0.992s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b58124e-ef0c-48de-906b-40f08aa73d0b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:59 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b58124e-ef0c-48de-906b-40f08aa73d0b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd Jul 03 01:10:59 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:00 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b58124e-ef0c-48de-906b-40f08aa73d0b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd" returned: 0 in 0.860s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:00 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:11:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:00 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd Jul 03 01:11:00 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:00 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Flow 'volume_create_manager' (7025ab84-34be-48ea-8532-91f56f69b283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45412323-db5c-4fec-b5b2-e19784a60952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45412323-db5c-4fec-b5b2-e19784a60952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1803323507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cca6eaf-2df9-4dec-89a2-a15ea7e70341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fab295f88bd4db3ba8ee6925354fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:01Z,use_quota=True,user_id='6992180bb7934086807f0bb6370ef4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020ed16d-9686-41f4-991f-19baa56392a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020ed16d-9686-41f4-991f-19baa56392a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3297c0c8-5af9-412b-8fc8-1d227fe40b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:00 devstack cinder-volume[86357]: DEBUG cinder.image.glance [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Creating Keystone auth plugin from conf {{(pid=86357) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:11:00 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd" returned: 0 in 0.886s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:00 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.info Jul 03 01:11:00 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3297c0c8-5af9-412b-8fc8-1d227fe40b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6cca6eaf-2df9-4dec-89a2-a15ea7e70341', 'volume_name': 'volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341', 'volume_size': 1, 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7645134c6d614f2bac5348098ce26f25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'created_at': datetime.datetime(2026, 7, 2, 22, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ab25ca-0b1f-4725-976d-5c5d200f20ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ab25ca-0b1f-4725-976d-5c5d200f20ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613511d5-f5a6-4ab5-9cc0-1f437eccd875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:01 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Volume 6cca6eaf-2df9-4dec-89a2-a15ea7e70341: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341', 'volume_size': 1, 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7645134c6d614f2bac5348098ce26f25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'created_at': datetime.datetime(2026, 7, 2, 22, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 01:11:01 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Trying to clone 6cca6eaf-2df9-4dec-89a2-a15ea7e70341 from image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]). {{(pid=86357) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:11:01 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.info" returned: 0 in 0.965s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:01 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:11:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:01 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.info Jul 03 01:11:01 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:01 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:11:01 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Image download 20.69 MB at 20.69 MB/s Jul 03 01:11:02 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e31b10-f232-49fe-a787-87b8eb8b3832]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:02 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD Jul 03 01:11:02 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:02 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.info" returned: 0 in 0.847s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Acquiring lock "cinder-quobyte-971f213c-1aa0-4e1c-84ec-b2680584d848" by "_copy_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Lock "cinder-quobyte-971f213c-1aa0-4e1c-84ec-b2680584d848" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] snapshot: 394867e0-4abd-4e90-8c6b-bb5ce71261bd, volume: 971f213c-1aa0-4e1c-84ec-b2680584d848, {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:11:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:02 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce79813-a66f-4b19-9954-9b46f8cc6189]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:03 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd Jul 03 01:11:03 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:03 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD" returned: 0 in 1.024s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:03 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Temporary image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd is fetched for user 6992180bb7934086807f0bb6370ef4ef. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:11:03 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[beea2132-3b51-4c9f-8534-371479db14f0]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:03 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD Jul 03 01:11:03 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:04 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd" returned: 0 in 1.098s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b58124e-ef0c-48de-906b-40f08aa73d0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:11:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:11:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Creating direct copy from snapshot {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:11:04 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[109a6c9f-92d4-4e24-b4c1-347b69a36e3d]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:04 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b Jul 03 01:11:04 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:04 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD" returned: 0 in 1.166s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:05 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b" returned: 0 in 1.148s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:05 devstack cinder-volume[86357]: DEBUG cinder.utils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Path /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848 not found in is_blk_device check {{(pid=86357) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:11:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:05 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848 Jul 03 01:11:05 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:11 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848" returned: 0 in 5.974s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:11 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[60965796-743c-42ef-8256-725b79144349]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:11 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b Jul 03 01:11:11 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:12 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b" returned: 0 in 0.962s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:12 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b, size 1024.00 MB, duration 5.98 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:11:12 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Converted 1024.00 MB image at 171.36 MB/s Jul 03 01:11:12 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:11:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:12 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848 Jul 03 01:11:12 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:12 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848" returned: 0 in 0.695s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Lock "cinder-quobyte-971f213c-1aa0-4e1c-84ec-b2680584d848" released by "_copy_volume_from_snapshot" :: held 10.031s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Acquiring lock "cinder-quobyte-394867e0-4abd-4e90-8c6b-bb5ce71261bd" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Lock "cinder-quobyte-394867e0-4abd-4e90-8c6b-bb5ce71261bd" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Deleting offline snapshot 394867e0-4abd-4e90-8c6b-bb5ce71261bd of volume 2b58124e-ef0c-48de-906b-40f08aa73d0b {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:11:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] snapshot_file for this snap is: volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:11:12 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cc2ca0-b1e2-4f70-acc6-b57a70d08380]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:13 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd Jul 03 01:11:13 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:13 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=68,cinder:UPDATE=80,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:11:13 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd" returned: 0 in 0.891s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b58124e-ef0c-48de-906b-40f08aa73d0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:11:13 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2356ffc-7a11-49af-a1c5-d6a69114d256]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:13 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b Jul 03 01:11:13 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:14 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b" returned: 0 in 0.927s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:14 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd Jul 03 01:11:14 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:15 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd" returned: 0 in 0.914s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:15 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd Jul 03 01:11:15 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:16 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b.394867e0-4abd-4e90-8c6b-bb5ce71261bd" returned: 0 in 0.876s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Lock "cinder-quobyte-394867e0-4abd-4e90-8c6b-bb5ce71261bd" released by "_delete_snapshot" :: held 3.756s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.591s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.340s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1803323507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cca6eaf-2df9-4dec-89a2-a15ea7e70341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fab295f88bd4db3ba8ee6925354fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:01Z,use_quota=True,user_id='6992180bb7934086807f0bb6370ef4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Creating volume 6cca6eaf-2df9-4dec-89a2-a15ea7e70341 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:16 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:11:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:16 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 1073741824 Jul 03 01:11:16 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-963a9a1d-a5fa-499e-bbaa-6671cd50e9a4 tempest-GroupsV314Test-743155 None] Create group from source-group-164b1878-f821-4c89-adcf-07db572592aa completed successfully. Jul 03 01:11:17 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 1073741824" returned: 0 in 1.178s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:17 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 Jul 03 01:11:17 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Acquiring lock "cinder-quobyte-971f213c-1aa0-4e1c-84ec-b2680584d848" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Lock "cinder-quobyte-971f213c-1aa0-4e1c-84ec-b2680584d848" acquired by "delete_volume" :: waited 0.047s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:18 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb30701f-e31d-473a-bd46-04550a25c241]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:18 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848 Jul 03 01:11:18 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:19 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341" returned: 0 in 1.218s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] <== create_volume: return (2458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.465s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Attempting download of 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd ((None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}])) to volume 6cca6eaf-2df9-4dec-89a2-a15ea7e70341. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c8a4aa-e406-42db-a1b1-8d9fc038a651]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_nhcef_fk {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:19 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_nhcef_fk Jul 03 01:11:19 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:19 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848" returned: 0 in 1.341s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:19 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848 Jul 03 01:11:19 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Flow 'volume_create_manager' (4d1a9cca-071d-4358-90d6-8ec8c209e0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83273db7-c4aa-4405-ac52-fba175626996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83273db7-c4aa-4405-ac52-fba175626996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1087796821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05324da-69d5-4e2c-b288-7bccf6cc403e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4d3191d97a4eed89f84494aeca2c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:20Z,use_quota=True,user_id='cadea5c09f3b4b019e65b281a7079601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07a74f2-72d4-4ef3-ba5d-bc62d9d4859f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07a74f2-72d4-4ef3-ba5d-bc62d9d4859f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c386e88c-05d5-4dff-bb3c-06d4fece5a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c386e88c-05d5-4dff-bb3c-06d4fece5a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e05324da-69d5-4e2c-b288-7bccf6cc403e', 'volume_name': 'volume-e05324da-69d5-4e2c-b288-7bccf6cc403e', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf72071f-b538-4ffa-b05c-9e111a4be0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf72071f-b538-4ffa-b05c-9e111a4be0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391c9cd2-67c6-458e-bcf7-3142c378959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:19 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Volume e05324da-69d5-4e2c-b288-7bccf6cc403e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e05324da-69d5-4e2c-b288-7bccf6cc403e', 'volume_size': 1} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1087796821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05324da-69d5-4e2c-b288-7bccf6cc403e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4d3191d97a4eed89f84494aeca2c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:20Z,use_quota=True,user_id='cadea5c09f3b4b019e65b281a7079601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Creating volume e05324da-69d5-4e2c-b288-7bccf6cc403e {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:19 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:11:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:19 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e 1073741824 Jul 03 01:11:19 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:20 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_nhcef_fk" returned: 0 in 1.089s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_nhcef_fk {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:20 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-971f213c-1aa0-4e1c-84ec-b2680584d848" returned: 0 in 0.808s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Lock "cinder-quobyte-971f213c-1aa0-4e1c-84ec-b2680584d848" released by "delete_volume" :: held 2.237s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:20 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_nhcef_fk Jul 03 01:11:20 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:20 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Created reservations ['efbd7fc0-846d-4468-a503-fde6f2b55567'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:20 devstack cinder-volume[86357]: WARNING cinder.quota [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-412763311 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-412763311, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:11:20 devstack cinder-volume[86357]: WARNING cinder.quota [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-412763311 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-412763311, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:11:20 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Created reservations ['cb28afd7-aa6b-4264-aaf0-523111c65ebb', '0843d719-62bd-4900-a20a-1a91ef44d55e', 'a5dc022f-3f8f-400b-926e-02809f0245e4', 'c2a3bb6b-056b-4873-a7c1-a91732692c85'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:20 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:11:20 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e 1073741824" returned: 0 in 1.233s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:21 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:21 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_nhcef_fk" returned: 1 in 0.889s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_nhcef_fk' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:11:21 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae14fda-e42a-48dc-877b-05e7c1318029]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:21 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e Jul 03 01:11:21 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:21 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD Jul 03 01:11:21 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:21 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.832s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:21 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:21 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6a4017f4-0360-4154-8925-c5eb93551401 tempest-GroupsV314Test-743155 None] Delete group completed successfully. Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Acquiring lock "cinder-quobyte-2b58124e-ef0c-48de-906b-40f08aa73d0b" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Lock "cinder-quobyte-2b58124e-ef0c-48de-906b-40f08aa73d0b" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:22 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e" returned: 0 in 0.985s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] <== create_volume: return (2287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.294s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391c9cd2-67c6-458e-bcf7-3142c378959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e05324da-69d5-4e2c-b288-7bccf6cc403e', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922b63ec-f8e7-4547-bf86-f58f2efbef3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4222d0-75ed-447c-b1c7-9092d9f3f65f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:22 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Volume volume-e05324da-69d5-4e2c-b288-7bccf6cc403e (e05324da-69d5-4e2c-b288-7bccf6cc403e): created successfully Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922b63ec-f8e7-4547-bf86-f58f2efbef3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:22 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Flow 'volume_create_manager' (4d1a9cca-071d-4358-90d6-8ec8c209e0bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD" returned: 0 in 1.017s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd was qcow2, converting to raw {{(pid=86357) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:11:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:22 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-309f91a1-0cb7-4876-8983-9259ed2152ff tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Created volume successfully. Jul 03 01:11:22 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 Jul 03 01:11:22 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:22 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b Jul 03 01:11:22 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:23 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b" returned: 0 in 1.004s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:23 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b Jul 03 01:11:23 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Creating offline snapshot 407adac1-7bfc-4eed-b553-7f9c05512621 of volume e05324da-69d5-4e2c-b288-7bccf6cc403e {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:11:23 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af4a42c-e3a2-4345-9c5d-9b754ad34621]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:23 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e Jul 03 01:11:23 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:24 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b58124e-ef0c-48de-906b-40f08aa73d0b" returned: 0 in 0.767s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Lock "cinder-quobyte-2b58124e-ef0c-48de-906b-40f08aa73d0b" released by "delete_volume" :: held 1.874s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Created reservations ['6bd9a7e1-f253-4075-b6b9-6573a852bc14'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Created reservations ['77e04a7b-6db0-4404-90d2-999e49d55102', '900056fd-d06c-4154-801b-89fc71813960', '33b8f24b-ccae-4b07-b95e-831bbb1bb7e1', '1899c2c9-173a-4883-9825-0c8d3b556897'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:24 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e" returned: 0 in 1.110s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:24 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 1G Jul 03 01:11:24 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:24 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:11:24 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:24 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341" returned: 0 in 2.588s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_valabfqmdevstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:11:24 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Converted 112.00 MB image at 43.21 MB/s Jul 03 01:11:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:24 devstack sudo[92996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 1G Jul 03 01:11:24 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:25 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.932s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:25 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1d3b0202-de72-4bdf-8798-fd96914b2c42 tempest-GroupsV314Test-743155 None] Delete group completed successfully. Jul 03 01:11:25 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 1G" returned: 0 in 1.171s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e05324da-69d5-4e2c-b288-7bccf6cc403e -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:25 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e05324da-69d5-4e2c-b288-7bccf6cc403e -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 Jul 03 01:11:25 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:25 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 1G" returned: 0 in 1.039s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:25 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[084de29d-67c2-4c12-97f8-4c13fa7d6ece]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:26 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 Jul 03 01:11:26 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:26 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e05324da-69d5-4e2c-b288-7bccf6cc403e -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621" returned: 0 in 0.971s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:26 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 is being set with open permissions: ugo+rw Jul 03 01:11:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:26 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 Jul 03 01:11:26 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:27 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341" returned: 0 in 1.032s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:27 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 Jul 03 01:11:27 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:27 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621" returned: 0 in 0.897s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:27 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.info Jul 03 01:11:27 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:11:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:11:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:11:28 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341" returned: 1 in 1.171s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:11:28 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Downloaded image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd ((None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}])) to volume 6cca6eaf-2df9-4dec-89a2-a15ea7e70341 successfully. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:11:28 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Temporary image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd for user 6992180bb7934086807f0bb6370ef4ef is deleted. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:11:28 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Marking volume 6cca6eaf-2df9-4dec-89a2-a15ea7e70341 as bootable. {{(pid=86357) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:11:28 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Copying metadata from image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd to 6cca6eaf-2df9-4dec-89a2-a15ea7e70341. {{(pid=86357) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:11:28 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Creating volume glance metadata for volume 6cca6eaf-2df9-4dec-89a2-a15ea7e70341 backed by image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86357) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:11:28 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.info" returned: 0 in 0.784s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:28 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.info is being set with open permissions: ugo+rw Jul 03 01:11:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:28 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.info Jul 03 01:11:28 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613511d5-f5a6-4ab5-9cc0-1f437eccd875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341', 'volume_size': 1, 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7645134c6d614f2bac5348098ce26f25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'created_at': datetime.datetime(2026, 7, 2, 22, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11206351-0877-4351-a7ab-3569c90870d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:28 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Volume volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 (6cca6eaf-2df9-4dec-89a2-a15ea7e70341): created successfully Jul 03 01:11:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11206351-0877-4351-a7ab-3569c90870d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Flow 'volume_create_manager' (7025ab84-34be-48ea-8532-91f56f69b283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:28 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-83e99da3-8dc9-4cb4-8f22-b0f7a3fb288c tempest-VolumesImageMetadata-63415507 None] Created volume successfully. Jul 03 01:11:29 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.info" returned: 0 in 0.867s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.918s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:29 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-310095e0-678e-4571-b08f-fa41b95a3ec2 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Create snapshot completed successfully Jul 03 01:11:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Acquiring lock "cinder-6cca6eaf-2df9-4dec-89a2-a15ea7e70341-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Lock "cinder-6cca6eaf-2df9-4dec-89a2-a15ea7e70341-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Acquiring lock "cinder-quobyte-6cca6eaf-2df9-4dec-89a2-a15ea7e70341" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Lock "cinder-quobyte-6cca6eaf-2df9-4dec-89a2-a15ea7e70341" acquired by "delete_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:29 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb22931-f3d4-4fd9-86dc-114694a37b62]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:29 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 Jul 03 01:11:29 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Acquiring lock "cinder-407adac1-7bfc-4eed-b553-7f9c05512621-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "cinder-407adac1-7bfc-4eed-b553-7f9c05512621-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Acquiring lock "cinder-quobyte-e05324da-69d5-4e2c-b288-7bccf6cc403e" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "cinder-quobyte-e05324da-69d5-4e2c-b288-7bccf6cc403e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Acquiring lock "cinder-quobyte-407adac1-7bfc-4eed-b553-7f9c05512621" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "cinder-quobyte-407adac1-7bfc-4eed-b553-7f9c05512621" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Deleting offline snapshot 407adac1-7bfc-4eed-b553-7f9c05512621 of volume e05324da-69d5-4e2c-b288-7bccf6cc403e {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:11:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] snapshot_file for this snap is: volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:11:30 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e73d28f-cabf-4ab7-bf56-cb18f4c03486]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:30 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 Jul 03 01:11:30 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:30 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341" returned: 0 in 0.912s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:30 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 Jul 03 01:11:30 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:31 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621" returned: 0 in 0.803s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e05324da-69d5-4e2c-b288-7bccf6cc403e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3357b4ea-fbad-45c4-93f4-01dab25bd4f0]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:31 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e Jul 03 01:11:31 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:31 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341" returned: 1 in 0.818s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:31 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341 Jul 03 01:11:31 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Flow 'volume_create_manager' (8f512c18-5716-47e8-9269-b63bc15bf569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef716fd-ed99-49fb-b700-4fd6750103d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef716fd-ed99-49fb-b700-4fd6750103d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-971628995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fc1730-56c4-47b7-a0be-0f0334808d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0a3fedc8b438b92e0e1f692f93519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:32Z,use_quota=True,user_id='aa9a9a5e2cc84a96ba3a479113e1eacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da09595-1d7f-4bb0-b193-eaed876af476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da09595-1d7f-4bb0-b193-eaed876af476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d36b22d-2d87-4a62-b79e-a09cbde3180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d36b22d-2d87-4a62-b79e-a09cbde3180c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0fc1730-56c4-47b7-a0be-0f0334808d35', 'volume_name': 'volume-b0fc1730-56c4-47b7-a0be-0f0334808d35', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa80b9d3-fdcd-416f-bd8b-f4c23e413347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa80b9d3-fdcd-416f-bd8b-f4c23e413347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18de60e-204f-4feb-baa3-dd2fe6d437c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:31 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Volume b0fc1730-56c4-47b7-a0be-0f0334808d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0fc1730-56c4-47b7-a0be-0f0334808d35', 'volume_size': 1} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-971628995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fc1730-56c4-47b7-a0be-0f0334808d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c0a3fedc8b438b92e0e1f692f93519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:32Z,use_quota=True,user_id='aa9a9a5e2cc84a96ba3a479113e1eacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Creating volume b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:31 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:11:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:31 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 1073741824 Jul 03 01:11:31 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:32 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e" returned: 0 in 0.912s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:32 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 Jul 03 01:11:32 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:32 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6cca6eaf-2df9-4dec-89a2-a15ea7e70341" returned: 0 in 0.701s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Lock "cinder-quobyte-6cca6eaf-2df9-4dec-89a2-a15ea7e70341" released by "delete_volume" :: held 2.514s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:32 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Created reservations ['5e42c45e-3f22-468f-bd93-7a5cde191e45', 'd17b210c-0a9a-445f-ad0d-58b425bc7ecd', 'b0c66b61-1f4d-4e1f-b06b-4f9fbdc382cc', 'bb5eb9c0-34ea-441a-bd92-a904e6ee359e'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:32 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:11:32 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:32 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 1073741824" returned: 0 in 0.901s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:32 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 Jul 03 01:11:32 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:33 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621" returned: 0 in 1.042s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:33 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621 Jul 03 01:11:33 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:33 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.829s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:33 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:33 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Deleted volume successfully. Jul 03 01:11:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2ad2552e-f1f5-43a4-9306-73ae4cb3030f tempest-VolumesImageMetadata-63415507 None] Lock "cinder-6cca6eaf-2df9-4dec-89a2-a15ea7e70341-delete_volume" released by "delete_volume" :: held 3.689s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:33 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35" returned: 0 in 1.038s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18de60e-204f-4feb-baa3-dd2fe6d437c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0fc1730-56c4-47b7-a0be-0f0334808d35', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a10114-27cf-4c21-9afc-310487b45f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:33 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Volume volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 (b0fc1730-56c4-47b7-a0be-0f0334808d35): created successfully Jul 03 01:11:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a10114-27cf-4c21-9afc-310487b45f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Flow 'volume_create_manager' (8f512c18-5716-47e8-9269-b63bc15bf569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:33 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-de6b8aae-b257-41fb-90b2-54eb870edd09 tempest-SnapshotsActionsTest-2041871000 None] Created volume successfully. Jul 03 01:11:34 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e.407adac1-7bfc-4eed-b553-7f9c05512621" returned: 0 in 0.944s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "cinder-quobyte-407adac1-7bfc-4eed-b553-7f9c05512621" released by "_delete_snapshot" :: held 3.914s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "cinder-quobyte-e05324da-69d5-4e2c-b288-7bccf6cc403e" released by "delete_snapshot" :: held 3.963s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:34 devstack cinder-volume[86357]: WARNING cinder.quota [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:11:34 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Created reservations ['f5b8fcc5-d751-4f22-9b6d-0d592fb9159f', 'a54cd747-f9fb-4271-9c37-63f11044367f', 'cfb3ae3a-cb63-44e4-9dfb-52fe3bd54343', '9189a40a-ecfd-45a5-855a-0eca46849977'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:34 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Delete snapshot completed successfully. Jul 03 01:11:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-98a9f1e7-24a4-45af-becb-6e4561d657e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "cinder-407adac1-7bfc-4eed-b553-7f9c05512621-delete_snapshot" released by "delete_snapshot" :: held 4.169s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Acquiring lock "cinder-e05324da-69d5-4e2c-b288-7bccf6cc403e-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "cinder-e05324da-69d5-4e2c-b288-7bccf6cc403e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Acquiring lock "cinder-quobyte-e05324da-69d5-4e2c-b288-7bccf6cc403e" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "cinder-quobyte-e05324da-69d5-4e2c-b288-7bccf6cc403e" acquired by "delete_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:34 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[543d1751-f5b4-4691-9e9d-8934595e627a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:34 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e Jul 03 01:11:34 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:35 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=98,cinder:UPDATE=138,cinder:DELETE=7,cinder:INSERT=35 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:11:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] Creating offline snapshot 5759c888-6cd8-400b-898c-b9b67afdb454 of volume b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:11:35 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a345ef-3e19-4bf0-94e5-f08dbb376a20]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:35 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 Jul 03 01:11:35 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:35 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e" returned: 0 in 1.197s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:35 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e Jul 03 01:11:35 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:36 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35" returned: 0 in 1.176s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:36 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 1G Jul 03 01:11:36 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:36 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e05324da-69d5-4e2c-b288-7bccf6cc403e" returned: 0 in 0.824s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "cinder-quobyte-e05324da-69d5-4e2c-b288-7bccf6cc403e" released by "delete_volume" :: held 2.101s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:36 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Created reservations ['a945a0b6-89f6-41b3-b247-71d4015e5691', '1f4b1882-1aee-46dc-a7a0-bca025de75b2', 'f78df116-2426-4bea-b78d-9724fded2fe7', '189fe35a-4afd-4edd-83c4-d6262f9dba36'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:36 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:11:36 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Flow 'volume_create_manager' (8bbb7db8-dda7-4fff-a492-66db39521c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9708fc9f-ab98-470e-8b1e-dae2f442f885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9708fc9f-ab98-470e-8b1e-dae2f442f885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-321255859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279cfa36-cdec-4192-8f43-297cd5550852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b9994fedb349b3bca63bd575f6b915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:37Z,use_quota=True,user_id='f5bf75f9316f4d049970741a557e3170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b1f4cf-e560-4219-ab80-cfd44bccfa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b1f4cf-e560-4219-ab80-cfd44bccfa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a4ba57-b88b-4111-bea7-7d07f0e246ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a4ba57-b88b-4111-bea7-7d07f0e246ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279cfa36-cdec-4192-8f43-297cd5550852', 'volume_name': 'volume-279cfa36-cdec-4192-8f43-297cd5550852', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287f255e-ebf7-4788-ba53-2a80865d0ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287f255e-ebf7-4788-ba53-2a80865d0ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8aa988-2a50-43cb-8096-22607f563dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:37 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Volume 279cfa36-cdec-4192-8f43-297cd5550852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279cfa36-cdec-4192-8f43-297cd5550852', 'volume_size': 1} Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:37 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 1G" returned: 0 in 1.008s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:37 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 Jul 03 01:11:37 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:37 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.717s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:37 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Deleted volume successfully. Jul 03 01:11:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-47c3704d-f6f0-4608-8239-742ceab0d02d tempest-VolumeSnapshotQuotasNegativeTestJSON-324581011 None] Lock "cinder-e05324da-69d5-4e2c-b288-7bccf6cc403e-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:38 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454" returned: 0 in 0.722s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:38 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 is being set with open permissions: ugo+rw Jul 03 01:11:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:38 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 Jul 03 01:11:38 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:38 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454" returned: 0 in 0.709s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:39 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.info Jul 03 01:11:39 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:39 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.info" returned: 0 in 0.746s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:39 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.info is being set with open permissions: ugo+rw Jul 03 01:11:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:39 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.info Jul 03 01:11:39 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:40 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.info" returned: 0 in 0.691s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.179s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.173s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-321255859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279cfa36-cdec-4192-8f43-297cd5550852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b9994fedb349b3bca63bd575f6b915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:37Z,use_quota=True,user_id='f5bf75f9316f4d049970741a557e3170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Creating volume 279cfa36-cdec-4192-8f43-297cd5550852 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:40 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:11:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-279cfa36-cdec-4192-8f43-297cd5550852 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:40 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-279cfa36-cdec-4192-8f43-297cd5550852 1073741824 Jul 03 01:11:40 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:40 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-48677cc1-7eb3-4280-8c84-113439f34894 tempest-SnapshotsActionsTest-2041871000 None] Create snapshot completed successfully Jul 03 01:11:41 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-279cfa36-cdec-4192-8f43-297cd5550852 1073741824" returned: 0 in 0.978s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-279cfa36-cdec-4192-8f43-297cd5550852 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:41 devstack sudo[93181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-279cfa36-cdec-4192-8f43-297cd5550852 Jul 03 01:11:41 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:42 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-279cfa36-cdec-4192-8f43-297cd5550852" returned: 0 in 1.376s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] <== create_volume: return (2423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.426s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8aa988-2a50-43cb-8096-22607f563dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279cfa36-cdec-4192-8f43-297cd5550852', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5b5db8-3b7b-424a-95f1-8b2a8429ebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:42 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Volume volume-279cfa36-cdec-4192-8f43-297cd5550852 (279cfa36-cdec-4192-8f43-297cd5550852): created successfully Jul 03 01:11:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5b5db8-3b7b-424a-95f1-8b2a8429ebfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Flow 'volume_create_manager' (8bbb7db8-dda7-4fff-a492-66db39521c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:43 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b483c855-2676-4260-a44f-814bd766a9ad tempest-VolumesMetadataTest-1766298850 None] Created volume successfully. Jul 03 01:11:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] Creating offline snapshot 46fc5910-e9df-43c6-8806-9568c24cfcf2 of volume b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:11:43 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7efbe2a-cf0d-4e91-af81-585a1f429d25]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:43 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 Jul 03 01:11:43 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:44 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454" returned: 0 in 1.485s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fc1730-56c4-47b7-a0be-0f0334808d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:11:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:44 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 1G Jul 03 01:11:44 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Acquiring lock "cinder-279cfa36-cdec-4192-8f43-297cd5550852-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Lock "cinder-279cfa36-cdec-4192-8f43-297cd5550852-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Acquiring lock "cinder-quobyte-279cfa36-cdec-4192-8f43-297cd5550852" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Lock "cinder-quobyte-279cfa36-cdec-4192-8f43-297cd5550852" acquired by "delete_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:44 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38d1118-5cd2-484a-87b9-5c61e67d7c16]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-279cfa36-cdec-4192-8f43-297cd5550852 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:45 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-279cfa36-cdec-4192-8f43-297cd5550852 Jul 03 01:11:45 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:46 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 1G" returned: 0 in 1.407s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:46 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-279cfa36-cdec-4192-8f43-297cd5550852" returned: 0 in 1.167s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-279cfa36-cdec-4192-8f43-297cd5550852 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:46 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 Jul 03 01:11:46 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:46 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-279cfa36-cdec-4192-8f43-297cd5550852 Jul 03 01:11:46 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:47 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2" returned: 0 in 0.996s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:47 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 is being set with open permissions: ugo+rw Jul 03 01:11:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:47 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 Jul 03 01:11:47 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:47 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-279cfa36-cdec-4192-8f43-297cd5550852" returned: 0 in 1.071s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Lock "cinder-quobyte-279cfa36-cdec-4192-8f43-297cd5550852" released by "delete_volume" :: held 2.313s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:47 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Created reservations ['f562a8ec-eb5e-4170-b2d2-75b21b89d3ef', '83e3c18f-5c1f-4806-9d2e-c2c5f55304b6', '97c0d0d1-3450-4a55-acb1-6ec6816ae6ae', 'c3e35baa-1666-4ba4-bb8e-d7127f0d786c'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:47 devstack sudo[93281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:11:47 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:48 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2" returned: 0 in 1.382s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.502s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:48 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-84504ee5-5f8a-4f6f-990f-328269424d4d tempest-SnapshotsActionsTest-2041871000 None] Create snapshot completed successfully Jul 03 01:11:48 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.229s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:48 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:48 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Deleted volume successfully. Jul 03 01:11:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-25a47739-f990-47d3-93d5-74f86c4fe00e tempest-VolumesMetadataTest-1766298850 None] Lock "cinder-279cfa36-cdec-4192-8f43-297cd5550852-delete_volume" released by "delete_volume" :: held 3.884s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Acquiring lock "cinder-46fc5910-e9df-43c6-8806-9568c24cfcf2-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-46fc5910-e9df-43c6-8806-9568c24cfcf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Acquiring lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Acquiring lock "cinder-quobyte-46fc5910-e9df-43c6-8806-9568c24cfcf2" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-46fc5910-e9df-43c6-8806-9568c24cfcf2" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Deleting offline snapshot 46fc5910-e9df-43c6-8806-9568c24cfcf2 of volume b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:11:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] snapshot_file for this snap is: volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:11:49 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f85789-33b8-4e93-a380-798ac5e69d94]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:49 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 Jul 03 01:11:49 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:50 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2" returned: 0 in 1.084s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:50 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fc1730-56c4-47b7-a0be-0f0334808d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:11:50 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da09878-e625-494f-947b-a82f266366fb]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:50 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 Jul 03 01:11:50 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:51 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454" returned: 0 in 0.959s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fc1730-56c4-47b7-a0be-0f0334808d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:11:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:51 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 Jul 03 01:11:51 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:52 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2" returned: 0 in 0.970s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:52 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2 Jul 03 01:11:52 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:53 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.46fc5910-e9df-43c6-8806-9568c24cfcf2" returned: 0 in 0.789s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-46fc5910-e9df-43c6-8806-9568c24cfcf2" released by "_delete_snapshot" :: held 3.917s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" released by "delete_snapshot" :: held 3.968s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:53 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Created reservations ['7950da16-c014-4d4b-9ebb-b91d8ad2aa0e', '492b8666-f153-43ff-b6a4-e40ff9d9d620', '0bb867c9-15cb-45d8-90e8-2faad6116193', 'b8a2ff8d-2008-4883-b6d5-6878fe495046'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:53 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Delete snapshot completed successfully. Jul 03 01:11:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6122888a-933f-43ce-a198-9bff6395f00e tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-46fc5910-e9df-43c6-8806-9568c24cfcf2-delete_snapshot" released by "delete_snapshot" :: held 4.198s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Flow 'volume_create_manager' (f6bffbec-afa3-464c-8e1a-017897f8ed07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06c0215-6b5a-4be8-ab54-196484337c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06c0215-6b5a-4be8-ab54-196484337c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1635954618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168575ca-eca0-4237-b328-b30192ac5b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c315e8ac4a46d7b44b518017d652de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:54Z,use_quota=True,user_id='d96547c31ac642b2bc06f092ea350f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fffded5-cd6e-4d2a-8412-856a36961588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fffded5-cd6e-4d2a-8412-856a36961588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff558a48-4726-4bd1-bfc3-c4ae5a336961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff558a48-4726-4bd1-bfc3-c4ae5a336961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '168575ca-eca0-4237-b328-b30192ac5b5d', 'volume_name': 'volume-168575ca-eca0-4237-b328-b30192ac5b5d', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d081b1-d35e-4a58-b048-f9c51f4b4e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d081b1-d35e-4a58-b048-f9c51f4b4e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4a667e-c999-485a-8d1c-e02efca90246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:54 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Volume 168575ca-eca0-4237-b328-b30192ac5b5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-168575ca-eca0-4237-b328-b30192ac5b5d', 'volume_size': 1} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1635954618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168575ca-eca0-4237-b328-b30192ac5b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c315e8ac4a46d7b44b518017d652de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:54Z,use_quota=True,user_id='d96547c31ac642b2bc06f092ea350f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Creating volume 168575ca-eca0-4237-b328-b30192ac5b5d {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:54 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-168575ca-eca0-4237-b328-b30192ac5b5d 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:54 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-168575ca-eca0-4237-b328-b30192ac5b5d 1073741824 Jul 03 01:11:54 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:55 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-168575ca-eca0-4237-b328-b30192ac5b5d 1073741824" returned: 0 in 0.963s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-168575ca-eca0-4237-b328-b30192ac5b5d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:55 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-168575ca-eca0-4237-b328-b30192ac5b5d Jul 03 01:11:55 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:56 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-168575ca-eca0-4237-b328-b30192ac5b5d" returned: 0 in 0.752s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.705s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4a667e-c999-485a-8d1c-e02efca90246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-168575ca-eca0-4237-b328-b30192ac5b5d', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446882f0-385f-4bdf-adc7-9ec7c1a0d338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] Creating offline snapshot db81ed2c-d3bb-4bb9-a79b-90edd4828744 of volume b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:11:56 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Volume volume-168575ca-eca0-4237-b328-b30192ac5b5d (168575ca-eca0-4237-b328-b30192ac5b5d): created successfully Jul 03 01:11:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446882f0-385f-4bdf-adc7-9ec7c1a0d338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Flow 'volume_create_manager' (f6bffbec-afa3-464c-8e1a-017897f8ed07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:56 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b06d18-2ebf-450b-8747-a75fa037ffd8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:56 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-cb99bdbd-599d-453a-9edd-a38f9d61c04a tempest-VolumesTransfersV357Test-682654558 None] Created volume successfully. Jul 03 01:11:56 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 Jul 03 01:11:56 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:57 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454" returned: 0 in 0.822s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fc1730-56c4-47b7-a0be-0f0334808d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:11:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:57 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 1G Jul 03 01:11:57 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:58 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 1G" returned: 0 in 0.985s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:58 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 Jul 03 01:11:58 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:58 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b15673f0-84a3-4b24-9f01-6bf64cae9b6b tempest-VolumesTransfersV357Test-14752257 None] Transfer volume completed successfully. Jul 03 01:11:59 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744" returned: 0 in 0.782s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:59 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 is being set with open permissions: ugo+rw Jul 03 01:11:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:59 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 Jul 03 01:11:59 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Acquiring lock "cinder-168575ca-eca0-4237-b328-b30192ac5b5d-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Lock "cinder-168575ca-eca0-4237-b328-b30192ac5b5d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Acquiring lock "cinder-quobyte-168575ca-eca0-4237-b328-b30192ac5b5d" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Lock "cinder-quobyte-168575ca-eca0-4237-b328-b30192ac5b5d" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:59 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4228807-0449-4833-bb6e-c3c11957ebd2]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-168575ca-eca0-4237-b328-b30192ac5b5d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:59 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744" returned: 0 in 0.719s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.477s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:59 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-32a574ab-7764-4306-8ddd-f6a23242628a tempest-SnapshotsActionsTest-2041871000 None] Create snapshot completed successfully Jul 03 01:11:59 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-168575ca-eca0-4237-b328-b30192ac5b5d Jul 03 01:11:59 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:00 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-168575ca-eca0-4237-b328-b30192ac5b5d" returned: 0 in 0.810s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-168575ca-eca0-4237-b328-b30192ac5b5d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:00 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-168575ca-eca0-4237-b328-b30192ac5b5d Jul 03 01:12:00 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Acquiring lock "cinder-db81ed2c-d3bb-4bb9-a79b-90edd4828744-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-db81ed2c-d3bb-4bb9-a79b-90edd4828744-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Acquiring lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Acquiring lock "cinder-quobyte-db81ed2c-d3bb-4bb9-a79b-90edd4828744" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-db81ed2c-d3bb-4bb9-a79b-90edd4828744" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Deleting offline snapshot db81ed2c-d3bb-4bb9-a79b-90edd4828744 of volume b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] snapshot_file for this snap is: volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[679f55a0-4a8c-4cee-92e5-e78457375bf8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:01 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 Jul 03 01:12:01 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:01 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-168575ca-eca0-4237-b328-b30192ac5b5d" returned: 0 in 0.719s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Lock "cinder-quobyte-168575ca-eca0-4237-b328-b30192ac5b5d" released by "delete_volume" :: held 1.586s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Created reservations ['f1261d8e-455c-4df9-9392-36d68e0913f4', '13c99be8-57f6-49f1-8c83-35170f9eb768', '8f49e264-fc1d-4cc0-ad2a-78636789830b', '7f47a24a-5dba-4653-a3b3-19072809051f'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:01 devstack sudo[93373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:12:01 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:02 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744" returned: 0 in 1.016s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fc1730-56c4-47b7-a0be-0f0334808d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[085c8f33-76e1-4167-9021-e29a7d880280]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:02 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 Jul 03 01:12:02 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:02 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.893s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:02 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Deleted volume successfully. Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bc1e3aae-2bf9-440e-98bd-9ebd5f66a2e7 tempest-VolumesTransfersV357Test-196693340 None] Lock "cinder-168575ca-eca0-4237-b328-b30192ac5b5d-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Flow 'volume_create_manager' (b4f2b953-2d01-41c2-9524-f3b5d11a139c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0137421e-e477-4772-88e0-35c8bd0cfad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0137421e-e477-4772-88e0-35c8bd0cfad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1196917841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89df208b-1b5c-4888-b812-ba4233f93dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c315e8ac4a46d7b44b518017d652de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:02Z,use_quota=True,user_id='d96547c31ac642b2bc06f092ea350f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e39daa2-6312-4065-aff2-516dd4580631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e39daa2-6312-4065-aff2-516dd4580631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db13ba86-46fc-45f6-ae82-f62670d6d105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db13ba86-46fc-45f6-ae82-f62670d6d105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89df208b-1b5c-4888-b812-ba4233f93dd0', 'volume_name': 'volume-89df208b-1b5c-4888-b812-ba4233f93dd0', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad6b3b7-d8bd-4d0f-8cff-e7486e528fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad6b3b7-d8bd-4d0f-8cff-e7486e528fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec1c7f9-627b-448c-9954-334a1f591a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:02 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Volume 89df208b-1b5c-4888-b812-ba4233f93dd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89df208b-1b5c-4888-b812-ba4233f93dd0', 'volume_size': 1} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1196917841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89df208b-1b5c-4888-b812-ba4233f93dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c315e8ac4a46d7b44b518017d652de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:02Z,use_quota=True,user_id='d96547c31ac642b2bc06f092ea350f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Creating volume 89df208b-1b5c-4888-b812-ba4233f93dd0 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:02 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:12:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89df208b-1b5c-4888-b812-ba4233f93dd0 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:02 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89df208b-1b5c-4888-b812-ba4233f93dd0 1073741824 Jul 03 01:12:02 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:03 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454" returned: 0 in 1.006s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:03 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fc1730-56c4-47b7-a0be-0f0334808d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:03 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 Jul 03 01:12:03 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:03 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89df208b-1b5c-4888-b812-ba4233f93dd0 1073741824" returned: 0 in 1.054s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89df208b-1b5c-4888-b812-ba4233f93dd0 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:03 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89df208b-1b5c-4888-b812-ba4233f93dd0 Jul 03 01:12:03 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:04 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744" returned: 0 in 1.096s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:04 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744 Jul 03 01:12:04 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:04 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89df208b-1b5c-4888-b812-ba4233f93dd0" returned: 0 in 0.826s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec1c7f9-627b-448c-9954-334a1f591a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89df208b-1b5c-4888-b812-ba4233f93dd0', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd4bdc7-18ab-4db4-81fe-97407668c25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:04 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Volume volume-89df208b-1b5c-4888-b812-ba4233f93dd0 (89df208b-1b5c-4888-b812-ba4233f93dd0): created successfully Jul 03 01:12:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd4bdc7-18ab-4db4-81fe-97407668c25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Flow 'volume_create_manager' (b4f2b953-2d01-41c2-9524-f3b5d11a139c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:04 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9904aff9-95b4-4ba8-9722-5002a5a17b96 tempest-VolumesTransfersV357Test-682654558 None] Created volume successfully. Jul 03 01:12:05 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.db81ed2c-d3bb-4bb9-a79b-90edd4828744" returned: 0 in 0.841s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-db81ed2c-d3bb-4bb9-a79b-90edd4828744" released by "_delete_snapshot" :: held 4.074s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" released by "delete_snapshot" :: held 4.099s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:05 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Created reservations ['0ef6666d-79fb-4db0-93eb-a5523fed920d', 'dc37a27f-ab31-4b85-b1b0-62a726c5e469', '4f29f7a6-8e05-4743-9719-d9450d46925b', '94ae229a-2b9b-480a-b2ed-4fb3d4e66c41'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:05 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Delete snapshot completed successfully. Jul 03 01:12:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1a4a990f-aed0-4160-8e8e-b9b55b5cf0d1 tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-db81ed2c-d3bb-4bb9-a79b-90edd4828744-delete_snapshot" released by "delete_snapshot" :: held 4.271s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] Creating offline snapshot 970ad8b1-5beb-46d1-81d3-4dd391f24784 of volume b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:12:05 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[556c4401-0ded-4a16-b109-ee25b0a4abea]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:05 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 Jul 03 01:12:05 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:06 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Acquiring lock "cinder-89df208b-1b5c-4888-b812-ba4233f93dd0-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:06 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Lock "cinder-89df208b-1b5c-4888-b812-ba4233f93dd0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:06 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Acquiring lock "cinder-quobyte-89df208b-1b5c-4888-b812-ba4233f93dd0" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:06 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Lock "cinder-quobyte-89df208b-1b5c-4888-b812-ba4233f93dd0" acquired by "delete_volume" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:06 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ef494f-f2c7-41c6-8be9-29e3b247715f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89df208b-1b5c-4888-b812-ba4233f93dd0 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:06 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89df208b-1b5c-4888-b812-ba4233f93dd0 Jul 03 01:12:06 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:06 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454" returned: 0 in 0.884s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fc1730-56c4-47b7-a0be-0f0334808d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:06 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 1G Jul 03 01:12:06 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:07 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89df208b-1b5c-4888-b812-ba4233f93dd0" returned: 0 in 0.881s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89df208b-1b5c-4888-b812-ba4233f93dd0 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:07 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89df208b-1b5c-4888-b812-ba4233f93dd0 Jul 03 01:12:07 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:07 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 1G" returned: 0 in 0.887s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:07 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 Jul 03 01:12:07 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:07 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89df208b-1b5c-4888-b812-ba4233f93dd0" returned: 0 in 0.716s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Lock "cinder-quobyte-89df208b-1b5c-4888-b812-ba4233f93dd0" released by "delete_volume" :: held 1.677s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:07 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Created reservations ['4b38fc9e-8f82-4c88-a679-3f25aafa0438', '52cf2dd7-3cbe-43d0-b65f-8abde4c98f03', '49b86b95-bf00-4578-ac62-4efe5d647071', '9f22dfca-e0c1-4f95-9c43-07cdfd20b16a'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:07 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:12:07 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:08 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784" returned: 0 in 0.792s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:08 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 is being set with open permissions: ugo+rw Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:08 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 Jul 03 01:12:08 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Flow 'volume_create_manager' (d8f895f6-1fa4-4100-8975-eef472889931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79b2e3f-5930-46ac-ae80-d3425b8e2719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79b2e3f-5930-46ac-ae80-d3425b8e2719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-716402550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b240c81f-76b4-470e-8ea2-2fe3ac3f85e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd8c651e3c3f478fad540df9b4e0e840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:09Z,use_quota=True,user_id='4405b6d9e4374d258b4fd028e2cc99e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c75877-87c1-4b5f-b748-0690bfc64b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c75877-87c1-4b5f-b748-0690bfc64b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f847ad8-f684-461f-8bb3-1b8fa2e3adcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f847ad8-f684-461f-8bb3-1b8fa2e3adcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b240c81f-76b4-470e-8ea2-2fe3ac3f85e4', 'volume_name': 'volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1905656b-9507-4b2f-8da9-f4f0939f8653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1905656b-9507-4b2f-8da9-f4f0939f8653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87f83c4-199d-47f7-b00e-2b7e13c23d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:08 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Volume b240c81f-76b4-470e-8ea2-2fe3ac3f85e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4', 'volume_size': 1} Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:08 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.969s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:08 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Deleted volume successfully. Jul 03 01:12:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3ff013e8-ac27-4859-ab6a-3ce80a86eca1 tempest-VolumesTransfersV357Test-196693340 None] Lock "cinder-89df208b-1b5c-4888-b812-ba4233f93dd0-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:09 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Flow 'volume_create_manager' (470bae9e-24f3-4166-8df6-28bf69124124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a834332e-266d-45e9-addf-833c01d5f7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784" returned: 0 in 0.895s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a834332e-266d-45e9-addf-833c01d5f7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1598614804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af3475b-b650-49c3-b383-6cfb28cfba51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0be851bb1b411e8bf6e517f6f77968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:09Z,use_quota=True,user_id='42e78cd3d60b42c08255799e6191b879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a4138d-e4ba-4b7e-bc4c-31dd31d11f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a4138d-e4ba-4b7e-bc4c-31dd31d11f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fe4807-bb3b-48ff-8761-931dfe096ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fe4807-bb3b-48ff-8761-931dfe096ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af3475b-b650-49c3-b383-6cfb28cfba51', 'volume_name': 'volume-1af3475b-b650-49c3-b383-6cfb28cfba51', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4668d8f-7c2f-42d5-bb7e-5900b7646ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4668d8f-7c2f-42d5-bb7e-5900b7646ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1504f2b-e82d-4042-9bef-1e277cdc8504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:09 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Volume 1af3475b-b650-49c3-b383-6cfb28cfba51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af3475b-b650-49c3-b383-6cfb28cfba51', 'volume_size': 1} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.641s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-716402550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b240c81f-76b4-470e-8ea2-2fe3ac3f85e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd8c651e3c3f478fad540df9b4e0e840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:09Z,use_quota=True,user_id='4405b6d9e4374d258b4fd028e2cc99e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Creating volume b240c81f-76b4-470e-8ea2-2fe3ac3f85e4 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:09 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:12:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:09 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4 1073741824 Jul 03 01:12:09 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:09 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9afed750-15fd-498c-ba28-c378f372d636 tempest-SnapshotsActionsTest-2041871000 None] Create snapshot completed successfully Jul 03 01:12:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Acquiring lock "cinder-970ad8b1-5beb-46d1-81d3-4dd391f24784-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-970ad8b1-5beb-46d1-81d3-4dd391f24784-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Acquiring lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Acquiring lock "cinder-quobyte-970ad8b1-5beb-46d1-81d3-4dd391f24784" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-970ad8b1-5beb-46d1-81d3-4dd391f24784" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Deleting offline snapshot 970ad8b1-5beb-46d1-81d3-4dd391f24784 of volume b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:12:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] snapshot_file for this snap is: volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:12:10 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[931064f0-55ec-495f-a88b-026c5fcfe172]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:10 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 Jul 03 01:12:10 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:10 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4 1073741824" returned: 0 in 0.965s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:10 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4 Jul 03 01:12:10 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:11 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784" returned: 0 in 0.924s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fc1730-56c4-47b7-a0be-0f0334808d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d405d0-8ad5-42d9-b706-86846937fdd8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:11 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4" returned: 0 in 0.763s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.803s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1598614804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af3475b-b650-49c3-b383-6cfb28cfba51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0be851bb1b411e8bf6e517f6f77968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:09Z,use_quota=True,user_id='42e78cd3d60b42c08255799e6191b879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Creating volume 1af3475b-b650-49c3-b383-6cfb28cfba51 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:11 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1af3475b-b650-49c3-b383-6cfb28cfba51 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87f83c4-199d-47f7-b00e-2b7e13c23d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:11 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1af3475b-b650-49c3-b383-6cfb28cfba51 1073741824 Jul 03 01:12:11 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7feb5ba7-a5cb-461d-8bb2-4e8f820676bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:11 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Volume volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4 (b240c81f-76b4-470e-8ea2-2fe3ac3f85e4): created successfully Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7feb5ba7-a5cb-461d-8bb2-4e8f820676bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Flow 'volume_create_manager' (d8f895f6-1fa4-4100-8975-eef472889931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:11 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a9cec41a-da38-485f-8fec-06c06c69c953 tempest-AttachVolumeShelveTestJSON-1558374533 None] Created volume successfully. Jul 03 01:12:11 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 Jul 03 01:12:11 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:12 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454" returned: 0 in 0.920s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fc1730-56c4-47b7-a0be-0f0334808d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:12 devstack sudo[93465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 Jul 03 01:12:12 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:12 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1af3475b-b650-49c3-b383-6cfb28cfba51 1073741824" returned: 0 in 1.071s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1af3475b-b650-49c3-b383-6cfb28cfba51 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:12 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1af3475b-b650-49c3-b383-6cfb28cfba51 Jul 03 01:12:12 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:13 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784" returned: 0 in 0.992s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:13 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784 Jul 03 01:12:13 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:13 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1af3475b-b650-49c3-b383-6cfb28cfba51" returned: 0 in 0.846s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1504f2b-e82d-4042-9bef-1e277cdc8504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af3475b-b650-49c3-b383-6cfb28cfba51', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ddfae2-eef2-40e0-9555-1b3029301147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:13 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Volume volume-1af3475b-b650-49c3-b383-6cfb28cfba51 (1af3475b-b650-49c3-b383-6cfb28cfba51): created successfully Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ddfae2-eef2-40e0-9555-1b3029301147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Flow 'volume_create_manager' (470bae9e-24f3-4166-8df6-28bf69124124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=113,cinder:SELECT=92,cinder:INSERT=36,cinder:DELETE=8 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:12:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-94acc061-dd28-4f7d-a283-e4b0e7afd2c0 tempest-AbsoluteLimitsTests-451213499 None] Created volume successfully. Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Acquiring lock "cinder-1af3475b-b650-49c3-b383-6cfb28cfba51-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Lock "cinder-1af3475b-b650-49c3-b383-6cfb28cfba51-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Acquiring lock "cinder-quobyte-1af3475b-b650-49c3-b383-6cfb28cfba51" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Lock "cinder-quobyte-1af3475b-b650-49c3-b383-6cfb28cfba51" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[08904185-6370-4bb5-94e3-48f8f30d3691]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1af3475b-b650-49c3-b383-6cfb28cfba51 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:13 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.970ad8b1-5beb-46d1-81d3-4dd391f24784" returned: 0 in 0.877s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-970ad8b1-5beb-46d1-81d3-4dd391f24784" released by "_delete_snapshot" :: held 3.831s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:13 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1af3475b-b650-49c3-b383-6cfb28cfba51 Jul 03 01:12:13 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" released by "delete_snapshot" :: held 3.861s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:14 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Created reservations ['eddc3ca2-ef52-41f4-920e-445975342bc4', 'a926cac2-287b-4b76-a4c1-46ef3d5bb38a', '74cb68f9-1308-420f-9937-3075cd391e01', '91d87214-8545-4fef-8a58-3800dae9c6ad'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:14 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Delete snapshot completed successfully. Jul 03 01:12:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2cb78844-38f4-4a6a-b663-d3718b1f593f tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-970ad8b1-5beb-46d1-81d3-4dd391f24784-delete_snapshot" released by "delete_snapshot" :: held 4.025s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:14 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1af3475b-b650-49c3-b383-6cfb28cfba51" returned: 0 in 0.809s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1af3475b-b650-49c3-b383-6cfb28cfba51 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] Creating offline snapshot d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 of volume b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:12:14 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1af3475b-b650-49c3-b383-6cfb28cfba51 Jul 03 01:12:14 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:14 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[063136ff-ef58-49b8-bd09-e38af248da8f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:14 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 Jul 03 01:12:14 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Flow 'volume_create_manager' (dff369a2-7985-4d32-83b0-d854a674af5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7baa48a0-6663-4d7a-b2f0-64fe147c8aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7baa48a0-6663-4d7a-b2f0-64fe147c8aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-699345953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adccb842-f4eb-43fc-8577-c2a3ca20278f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a785b8ab554cf6b145d82d0b0e30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:15Z,use_quota=True,user_id='f382d79dc95e4d44aaafefc878087307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978dfff3-d926-49e6-b211-033b6f0ac89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978dfff3-d926-49e6-b211-033b6f0ac89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a22f41-7cb4-455f-80f8-1e73c92da507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a22f41-7cb4-455f-80f8-1e73c92da507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adccb842-f4eb-43fc-8577-c2a3ca20278f', 'volume_name': 'volume-adccb842-f4eb-43fc-8577-c2a3ca20278f', 'volume_size': 2}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f291557f-c162-431f-9536-719fcab905bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f291557f-c162-431f-9536-719fcab905bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f11160-12cd-47e2-92be-c1740a4b6a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:15 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Volume adccb842-f4eb-43fc-8577-c2a3ca20278f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adccb842-f4eb-43fc-8577-c2a3ca20278f', 'volume_size': 2} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:15 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1af3475b-b650-49c3-b383-6cfb28cfba51" returned: 0 in 0.869s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Lock "cinder-quobyte-1af3475b-b650-49c3-b383-6cfb28cfba51" released by "delete_volume" :: held 1.733s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Created reservations ['205cc1a6-3700-440f-82bc-fe0319861bee', 'bd97ca93-f771-403b-aca6-3ec04d539515', 'c0e70f50-a589-4a3a-b0ce-5aa13627d167', '05dc6e94-13cb-40bb-8337-16dd03851bd3'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:15 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:12:15 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:15 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454" returned: 0 in 1.208s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fc1730-56c4-47b7-a0be-0f0334808d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:15 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 1G Jul 03 01:12:15 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:16 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.709s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:16 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Deleted volume successfully. Jul 03 01:12:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e97e0fad-66ef-405a-85a0-25657d712a6a tempest-AbsoluteLimitsTests-451213499 None] Lock "cinder-1af3475b-b650-49c3-b383-6cfb28cfba51-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:16 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 1G" returned: 0 in 0.968s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:16 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 Jul 03 01:12:16 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:17 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5" returned: 0 in 0.867s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:17 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 is being set with open permissions: ugo+rw Jul 03 01:12:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:17 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 Jul 03 01:12:17 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:18 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5" returned: 0 in 0.752s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.937s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.213s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-699345953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adccb842-f4eb-43fc-8577-c2a3ca20278f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a785b8ab554cf6b145d82d0b0e30b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:15Z,use_quota=True,user_id='f382d79dc95e4d44aaafefc878087307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Creating volume adccb842-f4eb-43fc-8577-c2a3ca20278f {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:18 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:12:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-adccb842-f4eb-43fc-8577-c2a3ca20278f 2147483648 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:18 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-adccb842-f4eb-43fc-8577-c2a3ca20278f 2147483648 Jul 03 01:12:18 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:18 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ed68a7e4-6c2c-48b6-bf8d-0b21da185226 tempest-SnapshotsActionsTest-2041871000 None] Create snapshot completed successfully Jul 03 01:12:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Acquiring lock "cinder-d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Acquiring lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Acquiring lock "cinder-quobyte-d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Deleting offline snapshot d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 of volume b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:12:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] snapshot_file for this snap is: volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:12:19 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca37fdc-d9e7-47e6-aed1-186f975cc2f8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:19 devstack sudo[93557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 Jul 03 01:12:19 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:19 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-adccb842-f4eb-43fc-8577-c2a3ca20278f 2147483648" returned: 0 in 1.314s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-adccb842-f4eb-43fc-8577-c2a3ca20278f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:20 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-adccb842-f4eb-43fc-8577-c2a3ca20278f Jul 03 01:12:20 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:20 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5" returned: 0 in 0.990s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fc1730-56c4-47b7-a0be-0f0334808d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:20 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f60afc-6a69-420e-9d9d-7c9c3c77acb7]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:20 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 Jul 03 01:12:20 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:20 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-adccb842-f4eb-43fc-8577-c2a3ca20278f" returned: 0 in 0.813s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.207s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f11160-12cd-47e2-92be-c1740a4b6a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adccb842-f4eb-43fc-8577-c2a3ca20278f', 'volume_size': 2}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc91027-03ee-4907-8cff-cb230d4ee556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:20 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Volume volume-adccb842-f4eb-43fc-8577-c2a3ca20278f (adccb842-f4eb-43fc-8577-c2a3ca20278f): created successfully Jul 03 01:12:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc91027-03ee-4907-8cff-cb230d4ee556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Flow 'volume_create_manager' (dff369a2-7985-4d32-83b0-d854a674af5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:20 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-cedc58f2-8f92-4a47-8c6c-f094d7e7ae81 tempest-VolumesCloneNegativeTest-730250251 None] Created volume successfully. Jul 03 01:12:21 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454" returned: 0 in 1.146s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fc1730-56c4-47b7-a0be-0f0334808d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:21 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 Jul 03 01:12:21 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Flow 'volume_create_manager' (bdd56ea5-d76d-4404-a57e-82657727c847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b946f6-d6e4-472c-b2ee-762f51e3408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b946f6-d6e4-472c-b2ee-762f51e3408e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-14819663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f56ecf8-c490-4504-b3ad-e48d6b4e5b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc7dbe3b03c44afac351cb73bf10c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:21Z,use_quota=True,user_id='3d0c342cfed34a68a873d6a0a12c8244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9017e259-879b-4185-a13b-7c4243be97cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9017e259-879b-4185-a13b-7c4243be97cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cee5df5-6c7e-4f33-abc6-72b091b6b244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cee5df5-6c7e-4f33-abc6-72b091b6b244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f56ecf8-c490-4504-b3ad-e48d6b4e5b96', 'volume_name': 'volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e776c76-5516-47d5-bdf3-cc970af3c6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e776c76-5516-47d5-bdf3-cc970af3c6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add4fd78-1dc6-4ec4-82f7-9a6f57be63a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:21 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Volume 8f56ecf8-c490-4504-b3ad-e48d6b4e5b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96', 'volume_size': 1} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-14819663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f56ecf8-c490-4504-b3ad-e48d6b4e5b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc7dbe3b03c44afac351cb73bf10c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:21Z,use_quota=True,user_id='3d0c342cfed34a68a873d6a0a12c8244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Creating volume 8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:21 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:21 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 1073741824 Jul 03 01:12:21 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Acquiring lock "cinder-adccb842-f4eb-43fc-8577-c2a3ca20278f-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Lock "cinder-adccb842-f4eb-43fc-8577-c2a3ca20278f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Acquiring lock "cinder-quobyte-adccb842-f4eb-43fc-8577-c2a3ca20278f" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Lock "cinder-quobyte-adccb842-f4eb-43fc-8577-c2a3ca20278f" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:22 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[4393218e-ccc4-47f4-88ea-bf3811e725ff]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-adccb842-f4eb-43fc-8577-c2a3ca20278f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:22 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-adccb842-f4eb-43fc-8577-c2a3ca20278f Jul 03 01:12:22 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:22 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5" returned: 0 in 1.005s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:22 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5 Jul 03 01:12:22 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:22 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 1073741824" returned: 0 in 1.128s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:22 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 Jul 03 01:12:22 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:22 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-adccb842-f4eb-43fc-8577-c2a3ca20278f" returned: 0 in 0.857s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-adccb842-f4eb-43fc-8577-c2a3ca20278f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:22 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-adccb842-f4eb-43fc-8577-c2a3ca20278f Jul 03 01:12:22 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:23 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5" returned: 0 in 0.712s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5" released by "_delete_snapshot" :: held 3.980s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" released by "delete_snapshot" :: held 4.002s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Created reservations ['e9f091bb-1f60-4828-b563-cd76dc643c0d', 'e298b1b6-799c-490d-800f-8d2c8010776e', 'edddf7ed-0e6c-44ce-aef4-7142e01f3d9a', '3a371e5e-2bd7-4690-91a9-c9d28e3dd3f0'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:23 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Delete snapshot completed successfully. Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b512ac2f-fa58-4d05-9b38-4e1d7ec547cd tempest-SnapshotsActionsTest-1147572782 None] Lock "cinder-d6cd28fe-ae0a-4e9f-9c04-6eae09f993c5-delete_snapshot" released by "delete_snapshot" :: held 4.177s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:23 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" returned: 0 in 0.795s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add4fd78-1dc6-4ec4-82f7-9a6f57be63a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f969c771-7479-451b-bcfc-692a2092f16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:23 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Volume volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 (8f56ecf8-c490-4504-b3ad-e48d6b4e5b96): created successfully Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f969c771-7479-451b-bcfc-692a2092f16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Flow 'volume_create_manager' (bdd56ea5-d76d-4404-a57e-82657727c847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:23 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-fa54e7ac-db38-4edf-acf2-42e973b95329 tempest-VolumesDeleteCascade-428329777 None] Created volume successfully. Jul 03 01:12:23 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-adccb842-f4eb-43fc-8577-c2a3ca20278f" returned: 0 in 0.777s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Lock "cinder-quobyte-adccb842-f4eb-43fc-8577-c2a3ca20278f" released by "delete_volume" :: held 1.723s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Created reservations ['7ab8713d-8f92-4504-a6bd-4740cbb7f8d3', 'c1509616-899f-4758-8ab0-1d9761907e08', 'ceee7a6f-14f4-40c2-b5de-3cd9b5875055', '059039cb-eff3-4473-8e09-55971ee902fe'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Acquiring lock "cinder-5759c888-6cd8-400b-898c-b9b67afdb454-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:23 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:12:23 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Lock "cinder-5759c888-6cd8-400b-898c-b9b67afdb454-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Acquiring lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Acquiring lock "cinder-quobyte-5759c888-6cd8-400b-898c-b9b67afdb454" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Lock "cinder-quobyte-5759c888-6cd8-400b-898c-b9b67afdb454" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Deleting offline snapshot 5759c888-6cd8-400b-898c-b9b67afdb454 of volume b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:12:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] snapshot_file for this snap is: volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:12:24 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c600c244-0513-4bba-81be-56f10bea8395]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:24 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 Jul 03 01:12:24 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:24 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.832s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:24 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:24 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Deleted volume successfully. Jul 03 01:12:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8b00fbf8-7fdb-4962-87d0-2e29184f36ee tempest-VolumesCloneNegativeTest-730250251 None] Lock "cinder-adccb842-f4eb-43fc-8577-c2a3ca20278f-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:24 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454" returned: 0 in 0.947s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fc1730-56c4-47b7-a0be-0f0334808d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:24 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[720cbd06-8dcb-4e11-b371-4019e5c5fee2]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] Creating offline snapshot df55cb5e-46e1-49f3-9c1c-b3a641b6d222 of volume 8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:12:25 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d2422b-61b5-4e2a-9623-6502a38e1b02]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:25 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 Jul 03 01:12:25 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 Jul 03 01:12:25 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:25 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:26 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" returned: 0 in 0.961s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:26 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 1G Jul 03 01:12:26 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:26 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35" returned: 0 in 1.157s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:26 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 Jul 03 01:12:26 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:27 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 1G" returned: 0 in 1.007s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:27 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 Jul 03 01:12:27 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:27 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454" returned: 0 in 0.976s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:27 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454 Jul 03 01:12:27 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:12:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:27 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:12:27 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:27 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35.5759c888-6cd8-400b-898c-b9b67afdb454" returned: 0 in 0.870s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Lock "cinder-quobyte-5759c888-6cd8-400b-898c-b9b67afdb454" released by "_delete_snapshot" :: held 4.143s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" released by "delete_snapshot" :: held 4.180s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:28 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Flow 'volume_create_manager' (07fcd5a2-3c95-4b27-bcac-2da4c6067d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f3cf9ff-fa23-4254-a2b1-9e5ac144aa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222" returned: 0 in 1.156s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:28 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 is being set with open permissions: ugo+rw Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f3cf9ff-fa23-4254-a2b1-9e5ac144aa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1459733220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de66b4b5-229d-42f7-955c-099bb46e0ddf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7e3829c4a49042d9a773cf276877c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:28Z,use_quota=True,user_id='10daa35a77314062b2d85898bb50a937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdca9d88-0e39-41bc-bdba-6af58db140bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:28 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 Jul 03 01:12:28 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdca9d88-0e39-41bc-bdba-6af58db140bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18008ea7-636a-46ee-b580-513429e0504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18008ea7-636a-46ee-b580-513429e0504d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de66b4b5-229d-42f7-955c-099bb46e0ddf', 'volume_name': 'volume-de66b4b5-229d-42f7-955c-099bb46e0ddf', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f064d0-c8c6-47fb-ada5-18651c90131a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f064d0-c8c6-47fb-ada5-18651c90131a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0cc44f-8747-4062-8078-ca21bac46668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:28 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Volume de66b4b5-229d-42f7-955c-099bb46e0ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de66b4b5-229d-42f7-955c-099bb46e0ddf', 'volume_size': 1} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Created reservations ['db837479-0a0f-41bf-a25a-bb6b60d8f79e', 'b7f76567-2ebd-4dee-9167-d41df43549f7', '17cfeebb-b057-4c99-a062-447ec4c7dcb7', '3d3654ff-16d5-4764-95b7-0ffc1267a025'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:28 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Delete snapshot completed successfully. Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e35692aa-2e75-4f6c-a05c-375b76ffaa8a tempest-SnapshotsActionsTest-2041871000 None] Lock "cinder-5759c888-6cd8-400b-898c-b9b67afdb454-delete_snapshot" released by "delete_snapshot" :: held 4.482s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:28 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.785s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-22dea249-2abd-4a9a-9494-00738737ed40 req-ac9c8775-c585-43ee-94ab-fd44221e2bbc tempest-AttachVolumeShelveTestJSON-1558374533 None] No connector for attachment f0115191-3393-41bf-8e94-f3576e9abef5; skipping storage backend terminate_connection call. {{(pid=86357) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-22dea249-2abd-4a9a-9494-00738737ed40 req-ac9c8775-c585-43ee-94ab-fd44221e2bbc tempest-AttachVolumeShelveTestJSON-1558374533 None] Deleting attachment f0115191-3393-41bf-8e94-f3576e9abef5. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:12:28 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222" returned: 0 in 0.776s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:29 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.info Jul 03 01:12:29 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Acquiring lock "cinder-b0fc1730-56c4-47b7-a0be-0f0334808d35-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Lock "cinder-b0fc1730-56c4-47b7-a0be-0f0334808d35-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Acquiring lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:29 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[da144e5d-9f6b-45ca-b27d-22defb3ee534]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:29 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 Jul 03 01:12:29 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:29 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.info" returned: 0 in 0.712s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:29 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.info is being set with open permissions: ugo+rw Jul 03 01:12:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:29 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.info Jul 03 01:12:29 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:30 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35" returned: 0 in 0.977s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:30 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35 Jul 03 01:12:30 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:30 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.info" returned: 0 in 0.821s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.577s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.312s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1459733220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de66b4b5-229d-42f7-955c-099bb46e0ddf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7e3829c4a49042d9a773cf276877c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:28Z,use_quota=True,user_id='10daa35a77314062b2d85898bb50a937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Creating volume de66b4b5-229d-42f7-955c-099bb46e0ddf {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:30 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:12:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de66b4b5-229d-42f7-955c-099bb46e0ddf 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:30 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de66b4b5-229d-42f7-955c-099bb46e0ddf 1073741824 Jul 03 01:12:30 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:30 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ccd55127-3970-4cfa-843d-b36b0a33a4e6 tempest-VolumesDeleteCascade-428329777 None] Create snapshot completed successfully Jul 03 01:12:31 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b0fc1730-56c4-47b7-a0be-0f0334808d35" returned: 0 in 0.741s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Lock "cinder-quobyte-b0fc1730-56c4-47b7-a0be-0f0334808d35" released by "delete_volume" :: held 1.792s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:31 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Created reservations ['2fc18911-6ab4-41ac-9475-6a6b1be8c60a', 'e13baa93-e3fa-4b06-a5b8-b984cd7356b9', '43bf22b3-1af8-4b9f-8de3-78ac50900ad4', '0fcd7f58-e634-4c98-a808-38fa2b9f55cf'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:31 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:12:31 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:31 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de66b4b5-229d-42f7-955c-099bb46e0ddf 1073741824" returned: 0 in 1.054s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de66b4b5-229d-42f7-955c-099bb46e0ddf {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:31 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de66b4b5-229d-42f7-955c-099bb46e0ddf Jul 03 01:12:31 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:32 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.802s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:32 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Deleted volume successfully. Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4b5e7fe7-dcc4-45f4-937e-4fa5813d33b2 tempest-SnapshotsActionsTest-2041871000 None] Lock "cinder-b0fc1730-56c4-47b7-a0be-0f0334808d35-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:32 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de66b4b5-229d-42f7-955c-099bb46e0ddf" returned: 0 in 0.762s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.931s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0cc44f-8747-4062-8078-ca21bac46668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de66b4b5-229d-42f7-955c-099bb46e0ddf', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31124e66-f168-498b-aa28-b3488243187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] Creating offline snapshot 78f34a08-2545-4ce7-be3e-70d7f33866a9 of volume 8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:12:32 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Volume volume-de66b4b5-229d-42f7-955c-099bb46e0ddf (de66b4b5-229d-42f7-955c-099bb46e0ddf): created successfully Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31124e66-f168-498b-aa28-b3488243187c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Flow 'volume_create_manager' (07fcd5a2-3c95-4b27-bcac-2da4c6067d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80ed85b-cc36-4470-a977-24ccdb9d3526]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:32 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-447dd70c-764e-42b8-a318-3c935606eec8 tempest-VolumesListTestJSON-1089445482 None] Created volume successfully. Jul 03 01:12:32 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 Jul 03 01:12:32 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:33 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222" returned: 0 in 0.881s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:33 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 1G Jul 03 01:12:33 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Flow 'volume_create_manager' (a596b4ba-4736-4b3a-8f5a-e1262f304967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcafa51b-2560-4734-a2c1-0d2ba902d5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcafa51b-2560-4734-a2c1-0d2ba902d5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-552361310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b38cefe-6e77-43b4-8323-f43402e7e5ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7e3829c4a49042d9a773cf276877c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:34Z,use_quota=True,user_id='10daa35a77314062b2d85898bb50a937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0643c352-5604-4a07-8255-c5ac0ad5e90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0643c352-5604-4a07-8255-c5ac0ad5e90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35aa774-a74e-4f21-bdd6-54798c8f395b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35aa774-a74e-4f21-bdd6-54798c8f395b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b38cefe-6e77-43b4-8323-f43402e7e5ab', 'volume_name': 'volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f291da4-2e9d-4803-bd43-280072cca189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f291da4-2e9d-4803-bd43-280072cca189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d6ee3d-659c-4df5-ad34-e64731b0ed4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:34 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Volume 2b38cefe-6e77-43b4-8323-f43402e7e5ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab', 'volume_size': 1} Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:34 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 1G" returned: 0 in 1.069s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:34 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 Jul 03 01:12:34 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:35 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9" returned: 0 in 0.725s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:35 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 is being set with open permissions: ugo+rw Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:35 devstack sudo[93701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 Jul 03 01:12:35 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:35 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9" returned: 0 in 0.698s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=91,cinder:INSERT=29,cinder:UPDATE=116,cinder:DELETE=12 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.538s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.771s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-552361310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b38cefe-6e77-43b4-8323-f43402e7e5ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7e3829c4a49042d9a773cf276877c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:34Z,use_quota=True,user_id='10daa35a77314062b2d85898bb50a937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Creating volume 2b38cefe-6e77-43b4-8323-f43402e7e5ab {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:35 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:12:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:36 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab 1073741824 Jul 03 01:12:36 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:36 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-cb572e0b-876f-40bf-9d49-e16902b8d229 tempest-VolumesDeleteCascade-428329777 None] Create snapshot completed successfully Jul 03 01:12:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Performing cascade delete. {{(pid=86357) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 01:12:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-78f34a08-2545-4ce7-be3e-70d7f33866a9-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-78f34a08-2545-4ce7-be3e-70d7f33866a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-quobyte-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-quobyte-78f34a08-2545-4ce7-be3e-70d7f33866a9" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-78f34a08-2545-4ce7-be3e-70d7f33866a9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Deleting offline snapshot 78f34a08-2545-4ce7-be3e-70d7f33866a9 of volume 8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:12:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] snapshot_file for this snap is: volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:12:37 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34ffa13-250f-495b-9f9f-7ed1ed9e8fb7]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:37 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab 1073741824" returned: 0 in 1.120s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:37 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 Jul 03 01:12:37 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:37 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab Jul 03 01:12:37 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:38 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab" returned: 0 in 0.834s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d6ee3d-659c-4df5-ad34-e64731b0ed4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6abb6f-584f-4724-901d-c62288e2bc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:38 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Volume volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab (2b38cefe-6e77-43b4-8323-f43402e7e5ab): created successfully Jul 03 01:12:38 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6abb6f-584f-4724-901d-c62288e2bc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Flow 'volume_create_manager' (a596b4ba-4736-4b3a-8f5a-e1262f304967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9" returned: 0 in 1.021s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:38 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-815fae8e-11ff-4167-934e-2a3498c569ef tempest-VolumesListTestJSON-1089445482 None] Created volume successfully. Jul 03 01:12:38 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[58732127-a17b-4f66-9e08-b330b049fedd]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:38 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 Jul 03 01:12:38 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Flow 'volume_create_manager' (a8c42d95-6f70-4d2e-a0fe-663bfbe84662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14666018-28b6-44fa-b622-b1b653bef6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14666018-28b6-44fa-b622-b1b653bef6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-778883864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30af7bc5-b926-4b89-be74-064fc4595362,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7e3829c4a49042d9a773cf276877c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:39Z,use_quota=True,user_id='10daa35a77314062b2d85898bb50a937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16facb7c-1221-4974-9436-338c23682cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16facb7c-1221-4974-9436-338c23682cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d56d98-a528-4077-a893-f5113328febf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d56d98-a528-4077-a893-f5113328febf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30af7bc5-b926-4b89-be74-064fc4595362', 'volume_name': 'volume-30af7bc5-b926-4b89-be74-064fc4595362', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2aa5e72-8a9e-42bf-9e5a-d5efbf71479c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2aa5e72-8a9e-42bf-9e5a-d5efbf71479c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:39 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f430a6e1-bb2f-4b83-9919-997dcff51fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:39 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Volume 30af7bc5-b926-4b89-be74-064fc4595362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30af7bc5-b926-4b89-be74-064fc4595362', 'volume_size': 1} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-778883864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30af7bc5-b926-4b89-be74-064fc4595362,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7e3829c4a49042d9a773cf276877c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:39Z,use_quota=True,user_id='10daa35a77314062b2d85898bb50a937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Creating volume 30af7bc5-b926-4b89-be74-064fc4595362 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:39 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-30af7bc5-b926-4b89-be74-064fc4595362 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222" returned: 0 in 1.092s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:39 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-30af7bc5-b926-4b89-be74-064fc4595362 1073741824 Jul 03 01:12:39 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:39 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 Jul 03 01:12:39 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:40 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9" returned: 0 in 1.184s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:40 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9 Jul 03 01:12:40 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:40 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-30af7bc5-b926-4b89-be74-064fc4595362 1073741824" returned: 0 in 1.299s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-30af7bc5-b926-4b89-be74-064fc4595362 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:40 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-30af7bc5-b926-4b89-be74-064fc4595362 Jul 03 01:12:40 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:41 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.78f34a08-2545-4ce7-be3e-70d7f33866a9" returned: 0 in 0.896s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-78f34a08-2545-4ce7-be3e-70d7f33866a9" released by "_delete_snapshot" :: held 4.332s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" released by "delete_snapshot" :: held 4.381s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Created reservations ['f41797d5-93d5-407b-a450-9fc1739b3d0f', '62ceb3c2-56de-44b6-a15c-2d0d62e5b2ef', '24398546-c930-4117-ad99-1396f30d28df', '2470d9ba-ea1d-470e-867b-8feaba89a60d'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:41 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Delete snapshot completed successfully. Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-78f34a08-2545-4ce7-be3e-70d7f33866a9-delete_snapshot" released by "delete_snapshot" :: held 4.653s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-df55cb5e-46e1-49f3-9c1c-b3a641b6d222-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-df55cb5e-46e1-49f3-9c1c-b3a641b6d222-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-quobyte-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-quobyte-df55cb5e-46e1-49f3-9c1c-b3a641b6d222" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-df55cb5e-46e1-49f3-9c1c-b3a641b6d222" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Deleting offline snapshot df55cb5e-46e1-49f3-9c1c-b3a641b6d222 of volume 8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] snapshot_file for this snap is: volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7efbc9-ce4a-4b47-a185-fcdc5da138bc]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:41 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-30af7bc5-b926-4b89-be74-064fc4595362" returned: 0 in 1.196s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] <== create_volume: return (2576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.579s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f430a6e1-bb2f-4b83-9919-997dcff51fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30af7bc5-b926-4b89-be74-064fc4595362', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54119c21-aea0-499a-9412-dc572955d8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:41 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Volume volume-30af7bc5-b926-4b89-be74-064fc4595362 (30af7bc5-b926-4b89-be74-064fc4595362): created successfully Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54119c21-aea0-499a-9412-dc572955d8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Flow 'volume_create_manager' (a8c42d95-6f70-4d2e-a0fe-663bfbe84662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:41 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6e2d154e-26e9-4dae-ab34-d72e992308e9 tempest-VolumesListTestJSON-1089445482 None] Created volume successfully. Jul 03 01:12:41 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 Jul 03 01:12:41 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:42 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222" returned: 0 in 1.056s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:42 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adf5776-4454-4846-8010-b6d5db86db1c]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:42 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 Jul 03 01:12:42 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:43 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" returned: 0 in 0.937s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:43 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 Jul 03 01:12:43 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:43 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Flow 'volume_create_manager' (ffa9953a-3d49-4675-87d5-2fa892fdf4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f194371-bb0e-47e0-8cd5-759038929751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f194371-bb0e-47e0-8cd5-759038929751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-532283845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef3613d-fd40-4629-8289-098af09811f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077b1e09e4ed49589e0dd5e1435e2741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:44Z,use_quota=True,user_id='d4018443070d4a5c81559f5544f66ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb700785-cde2-429e-98d3-c3b49bb958bd),volume_type_id=fb700785-cde2-429e-98d3-c3b49bb958bd)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bab5b9-20ee-45ce-846b-7c5c976f5713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bab5b9-20ee-45ce-846b-7c5c976f5713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024cfb70-54de-4a86-a4ed-d09238f37314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024cfb70-54de-4a86-a4ed-d09238f37314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef3613d-fd40-4629-8289-098af09811f7', 'volume_name': 'volume-8ef3613d-fd40-4629-8289-098af09811f7', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717f16f4-5bb4-409f-abca-c8fec794673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717f16f4-5bb4-409f-abca-c8fec794673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe9a673-f8d2-4157-8a47-4cf7d36e582c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:44 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Volume 8ef3613d-fd40-4629-8289-098af09811f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef3613d-fd40-4629-8289-098af09811f7', 'volume_size': 1} Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-532283845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef3613d-fd40-4629-8289-098af09811f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077b1e09e4ed49589e0dd5e1435e2741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:44Z,use_quota=True,user_id='d4018443070d4a5c81559f5544f66ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb700785-cde2-429e-98d3-c3b49bb958bd),volume_type_id=fb700785-cde2-429e-98d3-c3b49bb958bd)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Creating volume 8ef3613d-fd40-4629-8289-098af09811f7 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:44 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ef3613d-fd40-4629-8289-098af09811f7 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:44 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ef3613d-fd40-4629-8289-098af09811f7 1073741824 Jul 03 01:12:44 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:44 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222" returned: 0 in 1.082s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:44 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222 Jul 03 01:12:44 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "cinder-30af7bc5-b926-4b89-be74-064fc4595362-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Lock "cinder-30af7bc5-b926-4b89-be74-064fc4595362-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:45 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ef3613d-fd40-4629-8289-098af09811f7 1073741824" returned: 0 in 1.126s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "cinder-quobyte-30af7bc5-b926-4b89-be74-064fc4595362" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ef3613d-fd40-4629-8289-098af09811f7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Lock "cinder-quobyte-30af7bc5-b926-4b89-be74-064fc4595362" acquired by "delete_volume" :: waited 0.049s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:45 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ef3613d-fd40-4629-8289-098af09811f7 Jul 03 01:12:45 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:45 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e198d23-62b5-4ee9-a91b-ed3b751908c8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-30af7bc5-b926-4b89-be74-064fc4595362 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:45 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-30af7bc5-b926-4b89-be74-064fc4595362 Jul 03 01:12:45 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:45 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96.df55cb5e-46e1-49f3-9c1c-b3a641b6d222" returned: 0 in 0.883s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-df55cb5e-46e1-49f3-9c1c-b3a641b6d222" released by "_delete_snapshot" :: held 4.081s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" released by "delete_snapshot" :: held 4.111s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:45 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Created reservations ['9bbe3ba7-b050-4202-bf55-7174d928aaee', '7cdb21d1-ed1d-46ca-a348-775a72adf45e', 'a1bb30b7-4cb3-4e53-9988-bc332cdec8dc', 'e796c3f1-f31f-4e55-bafb-5853875507bb'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:46 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ef3613d-fd40-4629-8289-098af09811f7" returned: 0 in 0.762s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe9a673-f8d2-4157-8a47-4cf7d36e582c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef3613d-fd40-4629-8289-098af09811f7', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55357763-da2d-4202-a814-99ce22743768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:46 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Delete snapshot completed successfully. Jul 03 01:12:46 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Volume volume-8ef3613d-fd40-4629-8289-098af09811f7 (8ef3613d-fd40-4629-8289-098af09811f7): created successfully Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55357763-da2d-4202-a814-99ce22743768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Flow 'volume_create_manager' (ffa9953a-3d49-4675-87d5-2fa892fdf4bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-df55cb5e-46e1-49f3-9c1c-b3a641b6d222-delete_snapshot" released by "delete_snapshot" :: held 4.438s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Snapshots deleted, issuing volume delete {{(pid=86357) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-quobyte-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:46 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3f3a81ed-3b10-4ae2-a4fa-79c9e579690d tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Created volume successfully. Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[364cd7c4-4c47-4986-8bcc-81b6b2306771]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:46 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 Jul 03 01:12:46 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:46 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-30af7bc5-b926-4b89-be74-064fc4595362" returned: 0 in 0.951s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-30af7bc5-b926-4b89-be74-064fc4595362 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:46 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-30af7bc5-b926-4b89-be74-064fc4595362 Jul 03 01:12:46 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:46 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" returned: 0 in 0.759s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:46 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96 Jul 03 01:12:46 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:46 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-30af7bc5-b926-4b89-be74-064fc4595362" returned: 0 in 0.657s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Lock "cinder-quobyte-30af7bc5-b926-4b89-be74-064fc4595362" released by "delete_volume" :: held 1.681s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:46 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Created reservations ['2473a972-e6e6-41b5-b5e2-1da38d0d1a38', '4ec2d72e-bc16-4645-8842-519340e7a517', '55001b98-77b3-4018-a200-8c38cafc82a5', '18367063-b024-4b30-9d41-3ad55ebf5cf2'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:47 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:12:47 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "cinder-2b38cefe-6e77-43b4-8323-f43402e7e5ab-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Lock "cinder-2b38cefe-6e77-43b4-8323-f43402e7e5ab-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "cinder-quobyte-2b38cefe-6e77-43b4-8323-f43402e7e5ab" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Lock "cinder-quobyte-2b38cefe-6e77-43b4-8323-f43402e7e5ab" acquired by "delete_volume" :: waited 0.032s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a11fca8-8e9d-460c-a091-ef8258447c69]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:47 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" returned: 0 in 0.817s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96" released by "delete_volume" :: held 1.665s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-26a80330-22e7-44bd-8a8c-ad41cf412d4e tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-26a80330-22e7-44bd-8a8c-ad41cf412d4e tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-26a80330-22e7-44bd-8a8c-ad41cf412d4e tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-26a80330-22e7-44bd-8a8c-ad41cf412d4e tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-26a80330-22e7-44bd-8a8c-ad41cf412d4e tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-26a80330-22e7-44bd-8a8c-ad41cf412d4e tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:47 devstack sudo[93863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab Jul 03 01:12:47 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:47 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:12:47 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Created reservations ['a99cd210-3622-4349-b0b1-1b0cbd18f82c', '12eb2246-a3ac-4d4a-8dda-6e0d802784d0', 'f4d419a2-b6d0-477b-b638-099d09f93a85', '3f6ac04d-92c7-4080-9ca6-47c450d9fa20'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:47 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.868s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:47 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:47 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Deleted volume successfully. Jul 03 01:12:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e839df60-8bbf-4c65-8110-e8c314124445 tempest-VolumesListTestJSON-1089445482 None] Lock "cinder-30af7bc5-b926-4b89-be74-064fc4595362-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:48 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:12:48 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:48 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-26a80330-22e7-44bd-8a8c-ad41cf412d4e tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.832s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:48 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-26a80330-22e7-44bd-8a8c-ad41cf412d4e tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:48 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-26a80330-22e7-44bd-8a8c-ad41cf412d4e tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Retype volume completed successfully. Jul 03 01:12:48 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab" returned: 0 in 0.988s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:48 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab Jul 03 01:12:48 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:48 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.931s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:48 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:49 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Deleted volume successfully. Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7a3685cb-68c6-4bf6-8d5e-bd199a368ff3 tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-8f56ecf8-c490-4504-b3ad-e48d6b4e5b96-delete_volume" released by "delete_volume" :: held 12.181s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Acquiring lock "cinder-8ef3613d-fd40-4629-8289-098af09811f7-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Lock "cinder-8ef3613d-fd40-4629-8289-098af09811f7-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Flow 'volume_create_manager' (4486a72b-7e92-419e-b6b4-c041926c373b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40ac1a6-1ad3-4cc1-85e7-06ef6eb77eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40ac1a6-1ad3-4cc1-85e7-06ef6eb77eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1275845644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448413bc-be4e-4fe7-8253-cbbca18997cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc7dbe3b03c44afac351cb73bf10c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:49Z,use_quota=True,user_id='3d0c342cfed34a68a873d6a0a12c8244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d0f0a7-0936-4d63-9a8b-8a8c2231be94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d0f0a7-0936-4d63-9a8b-8a8c2231be94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8618c32a-1ab1-4fa5-8a6d-71d6e52514bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8618c32a-1ab1-4fa5-8a6d-71d6e52514bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '448413bc-be4e-4fe7-8253-cbbca18997cd', 'volume_name': 'volume-448413bc-be4e-4fe7-8253-cbbca18997cd', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cd0e09-c841-466d-9822-e36a3ca479aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cd0e09-c841-466d-9822-e36a3ca479aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd4624f-731a-4eff-ad79-cd641eb07b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:49 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Volume 448413bc-be4e-4fe7-8253-cbbca18997cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-448413bc-be4e-4fe7-8253-cbbca18997cd', 'volume_size': 1} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1275845644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448413bc-be4e-4fe7-8253-cbbca18997cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc7dbe3b03c44afac351cb73bf10c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:49Z,use_quota=True,user_id='3d0c342cfed34a68a873d6a0a12c8244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Creating volume 448413bc-be4e-4fe7-8253-cbbca18997cd {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:49 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Acquiring lock "cinder-quobyte-8ef3613d-fd40-4629-8289-098af09811f7" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:49 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd 1073741824 Jul 03 01:12:49 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Lock "cinder-quobyte-8ef3613d-fd40-4629-8289-098af09811f7" acquired by "delete_volume" :: waited 0.043s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[5653538f-556d-4457-953b-84388fcae67e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ef3613d-fd40-4629-8289-098af09811f7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:49 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ef3613d-fd40-4629-8289-098af09811f7 Jul 03 01:12:49 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:49 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b38cefe-6e77-43b4-8323-f43402e7e5ab" returned: 0 in 1.314s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Lock "cinder-quobyte-2b38cefe-6e77-43b4-8323-f43402e7e5ab" released by "delete_volume" :: held 2.396s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:50 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Created reservations ['c596458f-502c-4a37-b6c8-4f47ddb794ec', '3f711317-ba61-4261-b6e1-a02e51529b93', '8bde4558-a915-4ced-9434-b7fcca0cd785', '44b76eff-6090-4b29-bcf3-6d6c7eac3bf7'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:50 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:50 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:50 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:12:50 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:51 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ef3613d-fd40-4629-8289-098af09811f7" returned: 0 in 1.724s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ef3613d-fd40-4629-8289-098af09811f7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:51 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ef3613d-fd40-4629-8289-098af09811f7 Jul 03 01:12:51 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:51 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd 1073741824" returned: 0 in 1.944s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "cinder-de66b4b5-229d-42f7-955c-099bb46e0ddf-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:51 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd Jul 03 01:12:51 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Lock "cinder-de66b4b5-229d-42f7-955c-099bb46e0ddf-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:51 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "cinder-quobyte-de66b4b5-229d-42f7-955c-099bb46e0ddf" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.291s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:51 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:51 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Deleted volume successfully. Jul 03 01:12:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Lock "cinder-quobyte-de66b4b5-229d-42f7-955c-099bb46e0ddf" acquired by "delete_volume" :: waited 0.038s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:51 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[341f68b1-8090-4bcf-84bb-98f3b62090ba]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de66b4b5-229d-42f7-955c-099bb46e0ddf {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6aecd9df-0a93-4cad-be4f-d091addc6869 tempest-VolumesListTestJSON-1089445482 None] Lock "cinder-2b38cefe-6e77-43b4-8323-f43402e7e5ab-delete_volume" released by "delete_volume" :: held 4.265s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:52 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de66b4b5-229d-42f7-955c-099bb46e0ddf Jul 03 01:12:52 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:52 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ef3613d-fd40-4629-8289-098af09811f7" returned: 0 in 1.122s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Lock "cinder-quobyte-8ef3613d-fd40-4629-8289-098af09811f7" released by "delete_volume" :: held 2.904s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:52 devstack cinder-volume[86357]: WARNING cinder.quota [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:12:52 devstack cinder-volume[86357]: WARNING cinder.quota [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:12:52 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Created reservations ['c7433ab9-84e7-48d5-8d56-2ba413df61ca', '8347b5a8-da35-4e6c-8a5c-c7d0c512d31d', 'cf954625-5ed8-4827-8262-35235ed77464', '90345d3a-1132-43e1-8586-30033377855d'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd" returned: 0 in 0.983s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] <== create_volume: return (3079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.082s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd4624f-731a-4eff-ad79-cd641eb07b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-448413bc-be4e-4fe7-8253-cbbca18997cd', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce42a7a-4fd9-4c74-8365-1f8d60a6f3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:52 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Volume volume-448413bc-be4e-4fe7-8253-cbbca18997cd (448413bc-be4e-4fe7-8253-cbbca18997cd): created successfully Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce42a7a-4fd9-4c74-8365-1f8d60a6f3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Flow 'volume_create_manager' (4486a72b-7e92-419e-b6b4-c041926c373b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:52 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-5a1679a6-fc7c-42cc-ad12-aa88c9823cea tempest-VolumesDeleteCascade-428329777 None] Created volume successfully. Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:52 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:12:52 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:52 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de66b4b5-229d-42f7-955c-099bb46e0ddf" returned: 0 in 1.186s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de66b4b5-229d-42f7-955c-099bb46e0ddf {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:52 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de66b4b5-229d-42f7-955c-099bb46e0ddf Jul 03 01:12:52 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:53 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.884s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:53 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:53 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Deleted volume successfully. Jul 03 01:12:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9de78d86-f19f-476c-b012-17369cde0a27 tempest-VolumeRetypeWithoutMigrationTest-1424246279 None] Lock "cinder-8ef3613d-fd40-4629-8289-098af09811f7-delete_volume" released by "delete_volume" :: held 4.360s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] Creating offline snapshot 36334f36-3ba8-44aa-9d3f-69ebfa5588e9 of volume 448413bc-be4e-4fe7-8253-cbbca18997cd {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:12:53 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b782d61-bf29-4a75-abf7-159118cc1be9]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:53 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-de66b4b5-229d-42f7-955c-099bb46e0ddf" returned: 0 in 0.930s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Lock "cinder-quobyte-de66b4b5-229d-42f7-955c-099bb46e0ddf" released by "delete_volume" :: held 2.182s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:53 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Created reservations ['1bde42d1-b8f7-4792-a897-1345addc88be', 'af31bdd0-5f56-4674-8fcc-f53d05944fbd', 'df7bd210-95cb-42c4-a6d4-390ab2cd39d0', '056ef3cd-7f29-42de-9df8-4d0862f2ecde'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:53 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd Jul 03 01:12:53 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:54 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:12:54 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:54 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd" returned: 0 in 1.033s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:54 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.847s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:54 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:54 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Deleted volume successfully. Jul 03 01:12:54 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 1G Jul 03 01:12:54 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:54 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f4b61df5-01b6-454a-acbd-30b294654c97 tempest-VolumesListTestJSON-1089445482 None] Lock "cinder-de66b4b5-229d-42f7-955c-099bb46e0ddf-delete_volume" released by "delete_volume" :: held 3.399s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:56 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 1G" returned: 0 in 1.199s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-448413bc-be4e-4fe7-8253-cbbca18997cd -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:56 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-448413bc-be4e-4fe7-8253-cbbca18997cd -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 Jul 03 01:12:56 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:57 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-448413bc-be4e-4fe7-8253-cbbca18997cd -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9" returned: 0 in 1.050s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:57 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 is being set with open permissions: ugo+rw Jul 03 01:12:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:57 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 Jul 03 01:12:57 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:57 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9" returned: 0 in 0.831s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:58 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.info Jul 03 01:12:58 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:59 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.info" returned: 0 in 1.041s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:59 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.info is being set with open permissions: ugo+rw Jul 03 01:12:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:59 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.info Jul 03 01:12:59 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:00 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.info" returned: 0 in 1.123s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.427s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:00 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6c6329ba-4d7c-45fb-a5e4-9d8bf7679337 tempest-VolumesDeleteCascade-428329777 None] Create snapshot completed successfully Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Flow 'volume_create_manager' (9b9b68d1-8069-45f1-9da0-9c899c38c7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c64869-d39d-4c45-99bc-2f6bb664f473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c64869-d39d-4c45-99bc-2f6bb664f473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-38663523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01bf991-e2f1-4c2d-afb1-97607e4060c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc7dbe3b03c44afac351cb73bf10c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36334f36-3ba8-44aa-9d3f-69ebfa5588e9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:02Z,use_quota=True,user_id='3d0c342cfed34a68a873d6a0a12c8244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca6b8fe-70f6-498a-ad3f-9d4517382760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca6b8fe-70f6-498a-ad3f-9d4517382760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87f04f6-10d1-49bc-a1b5-8008c763fb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87f04f6-10d1-49bc-a1b5-8008c763fb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd01bf991-e2f1-4c2d-afb1-97607e4060c3', 'volume_name': 'volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3', 'volume_size': 1, 'snapshot_id': '36334f36-3ba8-44aa-9d3f-69ebfa5588e9'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebaf3c0-deba-412b-99ad-7bb12c38c522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebaf3c0-deba-412b-99ad-7bb12c38c522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47cd129-1359-4ead-a299-bd2eb4a504cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:02 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Volume d01bf991-e2f1-4c2d-afb1-97607e4060c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3', 'volume_size': 1, 'snapshot_id': '36334f36-3ba8-44aa-9d3f-69ebfa5588e9'} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-quobyte-36334f36-3ba8-44aa-9d3f-69ebfa5588e9-d01bf991-e2f1-4c2d-afb1-97607e4060c3" by "_create_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-36334f36-3ba8-44aa-9d3f-69ebfa5588e9-d01bf991-e2f1-4c2d-afb1-97607e4060c3" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Creating volume d01bf991-e2f1-4c2d-afb1-97607e4060c3 from snapshot 36334f36-3ba8-44aa-9d3f-69ebfa5588e9 {{(pid=86357) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-quobyte-d01bf991-e2f1-4c2d-afb1-97607e4060c3" by "_copy_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-d01bf991-e2f1-4c2d-afb1-97607e4060c3" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] snapshot: 36334f36-3ba8-44aa-9d3f-69ebfa5588e9, volume: d01bf991-e2f1-4c2d-afb1-97607e4060c3, {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[33898c4a-3dc4-423a-82f1-01ecc854ffd3]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:02 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 Jul 03 01:13:02 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:03 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9" returned: 0 in 1.258s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:03 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-448413bc-be4e-4fe7-8253-cbbca18997cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:13:03 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:13:03 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Creating direct copy from snapshot {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:13:03 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6ee5ca-10fb-405e-9ece-e7f15ec12810]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:03 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd Jul 03 01:13:03 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:04 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd" returned: 0 in 0.851s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:04 devstack cinder-volume[86357]: DEBUG cinder.utils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Path /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3 not found in is_blk_device check {{(pid=86357) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:13:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:04 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3 Jul 03 01:13:04 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:10 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Flow 'volume_create_manager' (c99dafae-fee2-443a-bfbd-37b544d07121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d1ed82-3dbc-402b-ae44-bb61833d6ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d1ed82-3dbc-402b-ae44-bb61833d6ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-940796959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99b407f-c363-4531-a373-f749fd0894d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b70d9e38af4173b1258961d2320e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:10Z,use_quota=True,user_id='09709adfc13c4a8f929d4382088a35d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aef9062e-1d49-4fe4-8208-920dc8cfa7ae),volume_type_id=aef9062e-1d49-4fe4-8208-920dc8cfa7ae)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9af90b-9338-412e-bc8c-ca8cdbe4123e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9af90b-9338-412e-bc8c-ca8cdbe4123e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138678cb-5aa5-4e20-b97a-62db46ad7c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138678cb-5aa5-4e20-b97a-62db46ad7c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c99b407f-c363-4531-a373-f749fd0894d1', 'volume_name': 'volume-c99b407f-c363-4531-a373-f749fd0894d1', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdee04e8-d096-43d2-a818-3210909f6ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdee04e8-d096-43d2-a818-3210909f6ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73ff074-9087-46ae-b909-a5dc3db51837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:10 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Volume c99b407f-c363-4531-a373-f749fd0894d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c99b407f-c363-4531-a373-f749fd0894d1', 'volume_size': 1} Jul 03 01:13:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:11 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3" returned: 0 in 7.149s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:11 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a42cac-2024-4c9e-b3a7-955f8ea2a9dc]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:11 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd Jul 03 01:13:11 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:12 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd" returned: 0 in 1.254s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:12 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd, size 1024.00 MB, duration 7.15 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:13:12 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Converted 1024.00 MB image at 143.23 MB/s Jul 03 01:13:12 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3 is being set with open permissions: ugo+rw Jul 03 01:13:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:13 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3 Jul 03 01:13:13 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:13 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3" returned: 0 in 0.763s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=108,cinder:INSERT=29,cinder:UPDATE=119,cinder:DELETE=9 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-d01bf991-e2f1-4c2d-afb1-97607e4060c3" released by "_copy_volume_from_snapshot" :: held 11.427s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Flow 'volume_create_manager' (77291840-a89d-461f-9a06-6657dd5e575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58878c7d-c42f-4e63-985b-8c4170f358dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-36334f36-3ba8-44aa-9d3f-69ebfa5588e9-d01bf991-e2f1-4c2d-afb1-97607e4060c3" released by "_create_volume_from_snapshot" :: held 11.511s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.537s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.249s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-940796959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99b407f-c363-4531-a373-f749fd0894d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b70d9e38af4173b1258961d2320e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:10Z,use_quota=True,user_id='09709adfc13c4a8f929d4382088a35d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aef9062e-1d49-4fe4-8208-920dc8cfa7ae),volume_type_id=aef9062e-1d49-4fe4-8208-920dc8cfa7ae)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Creating volume c99b407f-c363-4531-a373-f749fd0894d1 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:13 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c99b407f-c363-4531-a373-f749fd0894d1 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:13 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c99b407f-c363-4531-a373-f749fd0894d1 1073741824 Jul 03 01:13:13 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58878c7d-c42f-4e63-985b-8c4170f358dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2033878589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652d3d2d-d8a1-41d2-aff4-f0b59298d356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1275129ff042b4af5b63d62580c760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:14Z,use_quota=True,user_id='3e64b4ae851341d4938e29a2915dce2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d21fbe6-6a03-405a-8936-47c00b0d31f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d21fbe6-6a03-405a-8936-47c00b0d31f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2e5530-ecc6-4b3f-97b5-56d119778fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2e5530-ecc6-4b3f-97b5-56d119778fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '652d3d2d-d8a1-41d2-aff4-f0b59298d356', 'volume_name': 'volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa62b8d8-3955-4b54-938f-5de61282884c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa62b8d8-3955-4b54-938f-5de61282884c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4c5041-801d-4244-aa66-5b5e3361ce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:13 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Volume 652d3d2d-d8a1-41d2-aff4-f0b59298d356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356', 'volume_size': 1} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47cd129-1359-4ead-a299-bd2eb4a504cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3', 'volume_size': 1, 'snapshot_id': '36334f36-3ba8-44aa-9d3f-69ebfa5588e9'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f3fe3d-4e98-47ab-94d6-4cedefbb411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:13 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Volume volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3 (d01bf991-e2f1-4c2d-afb1-97607e4060c3): created successfully Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f3fe3d-4e98-47ab-94d6-4cedefbb411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Flow 'volume_create_manager' (9b9b68d1-8069-45f1-9da0-9c899c38c7d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6fa12d07-718a-464a-9e8c-6fd6c316a34f tempest-VolumesDeleteCascade-428329777 None] Created volume successfully. Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-448413bc-be4e-4fe7-8253-cbbca18997cd-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-448413bc-be4e-4fe7-8253-cbbca18997cd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:14 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c99b407f-c363-4531-a373-f749fd0894d1 1073741824" returned: 0 in 1.047s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Performing cascade delete. {{(pid=86357) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-36334f36-3ba8-44aa-9d3f-69ebfa5588e9-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-36334f36-3ba8-44aa-9d3f-69ebfa5588e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c99b407f-c363-4531-a373-f749fd0894d1 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:14 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c99b407f-c363-4531-a373-f749fd0894d1 Jul 03 01:13:14 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-quobyte-448413bc-be4e-4fe7-8253-cbbca18997cd" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-448413bc-be4e-4fe7-8253-cbbca18997cd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-quobyte-36334f36-3ba8-44aa-9d3f-69ebfa5588e9" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-36334f36-3ba8-44aa-9d3f-69ebfa5588e9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Deleting offline snapshot 36334f36-3ba8-44aa-9d3f-69ebfa5588e9 of volume 448413bc-be4e-4fe7-8253-cbbca18997cd {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] snapshot_file for this snap is: volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[7634a68d-a0f2-49f1-870f-eeb74de6d182]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:15 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 Jul 03 01:13:15 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:15 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c99b407f-c363-4531-a373-f749fd0894d1" returned: 0 in 0.646s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.677s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2033878589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652d3d2d-d8a1-41d2-aff4-f0b59298d356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1275129ff042b4af5b63d62580c760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:14Z,use_quota=True,user_id='3e64b4ae851341d4938e29a2915dce2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Creating volume 652d3d2d-d8a1-41d2-aff4-f0b59298d356 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:15 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:15 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 1073741824 Jul 03 01:13:15 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73ff074-9087-46ae-b909-a5dc3db51837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c99b407f-c363-4531-a373-f749fd0894d1', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d1720e-8d37-4270-91d2-7a6bae00fdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:15 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Volume volume-c99b407f-c363-4531-a373-f749fd0894d1 (c99b407f-c363-4531-a373-f749fd0894d1): created successfully Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d1720e-8d37-4270-91d2-7a6bae00fdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Flow 'volume_create_manager' (c99dafae-fee2-443a-bfbd-37b544d07121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:15 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-0828c767-d796-4852-96c2-30487aa33c0b tempest-VolumeTypesAccessTest-2002309012 None] Created volume successfully. Jul 03 01:13:15 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9" returned: 0 in 0.910s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-448413bc-be4e-4fe7-8253-cbbca18997cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[45008723-5612-4138-aa6b-089496ee9e7f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:16 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd Jul 03 01:13:16 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:16 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 1073741824" returned: 0 in 0.989s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:16 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 Jul 03 01:13:16 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:16 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd" returned: 0 in 0.855s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:16 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 Jul 03 01:13:16 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Acquiring lock "cinder-c99b407f-c363-4531-a373-f749fd0894d1-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Lock "cinder-c99b407f-c363-4531-a373-f749fd0894d1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Acquiring lock "cinder-quobyte-c99b407f-c363-4531-a373-f749fd0894d1" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Lock "cinder-quobyte-c99b407f-c363-4531-a373-f749fd0894d1" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:17 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e63e03-5894-4d19-b463-9dd41ea27fc3]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c99b407f-c363-4531-a373-f749fd0894d1 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:17 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c99b407f-c363-4531-a373-f749fd0894d1 Jul 03 01:13:17 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:17 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356" returned: 0 in 0.794s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4c5041-801d-4244-aa66-5b5e3361ce71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3baa14ec-6ba9-420e-8c37-0313c6a11a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:17 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Volume volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 (652d3d2d-d8a1-41d2-aff4-f0b59298d356): created successfully Jul 03 01:13:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3baa14ec-6ba9-420e-8c37-0313c6a11a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Flow 'volume_create_manager' (77291840-a89d-461f-9a06-6657dd5e575b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:17 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-61eb1e8b-61a8-4cda-9697-fd86100333cc tempest-VolumesSnapshotTestJSON-1076177584 None] Created volume successfully. Jul 03 01:13:17 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9" returned: 0 in 0.885s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:17 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9 Jul 03 01:13:17 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:17 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c99b407f-c363-4531-a373-f749fd0894d1" returned: 0 in 0.810s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c99b407f-c363-4531-a373-f749fd0894d1 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:17 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c99b407f-c363-4531-a373-f749fd0894d1 Jul 03 01:13:17 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] Creating offline snapshot 1fa655b4-b2d8-4227-a18a-27b5b5065d3b of volume 652d3d2d-d8a1-41d2-aff4-f0b59298d356 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8403065-7791-4c24-b845-783362ed297b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:18 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd.36334f36-3ba8-44aa-9d3f-69ebfa5588e9" returned: 0 in 0.737s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-36334f36-3ba8-44aa-9d3f-69ebfa5588e9" released by "_delete_snapshot" :: held 3.523s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-448413bc-be4e-4fe7-8253-cbbca18997cd" released by "delete_snapshot" :: held 3.551s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Created reservations ['f865e09d-485c-42b1-9c10-e40ab2141061', 'e52cb50c-db90-4069-b5a7-ac7d702d037a', '110457a1-2438-427d-9cc9-2ada8da90202', '42bd6343-a8ef-4cea-a78d-0c427174847a'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:18 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 Jul 03 01:13:18 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:18 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c99b407f-c363-4531-a373-f749fd0894d1" returned: 0 in 0.738s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Lock "cinder-quobyte-c99b407f-c363-4531-a373-f749fd0894d1" released by "delete_volume" :: held 1.609s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:18 devstack cinder-volume[86357]: WARNING cinder.quota [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1026231587 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1026231587, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:13:18 devstack cinder-volume[86357]: WARNING cinder.quota [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1026231587 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1026231587, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:13:18 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Delete snapshot completed successfully. Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-36334f36-3ba8-44aa-9d3f-69ebfa5588e9-delete_snapshot" released by "delete_snapshot" :: held 3.756s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Snapshots deleted, issuing volume delete {{(pid=86357) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-quobyte-448413bc-be4e-4fe7-8253-cbbca18997cd" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Created reservations ['0b1e8b78-8f59-4934-bb15-89c9fd3075cd', '18826d69-3c72-4d50-8a03-eb207905e140', '5e5f743e-07dd-4f95-af94-7e0696d3e4dc', 'ef16f712-751c-4d85-8bf2-4d092178edbe'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-448413bc-be4e-4fe7-8253-cbbca18997cd" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aaf3db-9d57-4140-a36d-43c0906d0901]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:18 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:13:18 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:18 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd Jul 03 01:13:18 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:19 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356" returned: 0 in 0.891s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:19 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b 1G Jul 03 01:13:19 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:19 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.914s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:19 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:19 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Deleted volume successfully. Jul 03 01:13:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8a5275ec-1a38-4b46-bf87-9081492a9d91 tempest-VolumeTypesAccessTest-2002309012 None] Lock "cinder-c99b407f-c363-4531-a373-f749fd0894d1-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:19 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd" returned: 0 in 1.070s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:19 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd Jul 03 01:13:19 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:20 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b 1G" returned: 0 in 1.061s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:20 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b Jul 03 01:13:20 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:20 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-448413bc-be4e-4fe7-8253-cbbca18997cd" returned: 0 in 0.724s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-448413bc-be4e-4fe7-8253-cbbca18997cd" released by "delete_volume" :: held 1.861s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:20 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Created reservations ['5a9f61f1-f0d2-4a48-bafa-b8c63b011638', 'deadb5d9-5ae0-4567-867d-be7e7ffd1c56', '23e21a5e-c613-4b9f-8c30-f79af9b512aa', '5eb61e65-571c-41e0-8ba8-f7ea82658cc1'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:20 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:13:20 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:21 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b" returned: 0 in 0.929s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:21 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b is being set with open permissions: ugo+rw Jul 03 01:13:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:21 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b Jul 03 01:13:21 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-d01bf991-e2f1-4c2d-afb1-97607e4060c3-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-d01bf991-e2f1-4c2d-afb1-97607e4060c3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "cinder-quobyte-d01bf991-e2f1-4c2d-afb1-97607e4060c3" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-d01bf991-e2f1-4c2d-afb1-97607e4060c3" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:21 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f25085-f1fa-4ffe-bcbb-073a58e890c6]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:21 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.998s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:21 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:21 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Deleted volume successfully. Jul 03 01:13:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab571aee-d624-4f4f-83ae-01c369e77a1d tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-448413bc-be4e-4fe7-8253-cbbca18997cd-delete_volume" released by "delete_volume" :: held 7.024s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:21 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3 Jul 03 01:13:21 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Acquiring lock "cinder-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Lock "cinder-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Acquiring lock "cinder-quobyte-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Lock "cinder-quobyte-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4" acquired by "delete_volume" :: waited 0.037s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:22 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[982b9447-f676-4cab-8587-12a637637176]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:22 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b" returned: 0 in 1.094s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:22 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4 Jul 03 01:13:22 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:22 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.info Jul 03 01:13:22 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3" returned: 0 in 1.038s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:22 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:22 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3 Jul 03 01:13:22 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:23 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.info" returned: 0 in 0.861s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:23 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.info is being set with open permissions: ugo+rw Jul 03 01:13:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:23 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4" returned: 0 in 0.977s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:23 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.info Jul 03 01:13:23 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:23 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4 Jul 03 01:13:23 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:23 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d01bf991-e2f1-4c2d-afb1-97607e4060c3" returned: 0 in 0.893s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-quobyte-d01bf991-e2f1-4c2d-afb1-97607e4060c3" released by "delete_volume" :: held 1.988s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:23 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Created reservations ['a60ea657-551a-428a-8892-b08cc2d1b7fb', '4191776a-9ec5-4a20-b442-b1b74716ecf5', 'a067a671-b577-4bf6-af46-4fb3dabe629f', '59efa5d0-2865-4aa9-a2df-323c2d012749'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:23 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:13:23 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:24 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4" returned: 0 in 0.967s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:24 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.info" returned: 0 in 1.005s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.955s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Lock "cinder-quobyte-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4" released by "delete_volume" :: held 2.035s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:24 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-17a11831-47ee-4546-889f-f787411bf300 tempest-VolumesSnapshotTestJSON-1076177584 None] Create snapshot completed successfully Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Created reservations ['9ac857e2-c679-409b-99bd-394584b71563', '43305b47-6f81-403b-85bb-767922586c34', '289fa107-b084-4a07-95ea-d0106de9c366', '65817736-8ae3-48be-aa69-bb226deed393'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:24 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:13:24 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:24 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.822s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:24 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Deleted volume successfully. Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ad713e77-f3cc-4d94-8bac-b166a6d197dd tempest-VolumesDeleteCascade-428329777 None] Lock "cinder-d01bf991-e2f1-4c2d-afb1-97607e4060c3-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-1fa655b4-b2d8-4227-a18a-27b5b5065d3b-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-1fa655b4-b2d8-4227-a18a-27b5b5065d3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-652d3d2d-d8a1-41d2-aff4-f0b59298d356" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-652d3d2d-d8a1-41d2-aff4-f0b59298d356" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-1fa655b4-b2d8-4227-a18a-27b5b5065d3b" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-1fa655b4-b2d8-4227-a18a-27b5b5065d3b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Deleting offline snapshot 1fa655b4-b2d8-4227-a18a-27b5b5065d3b of volume 652d3d2d-d8a1-41d2-aff4-f0b59298d356 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:13:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] snapshot_file for this snap is: volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:13:25 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbc1583-8f07-4e9f-afde-73c298e06840]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:25 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b Jul 03 01:13:25 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:25 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.911s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:25 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Deleted volume successfully. Jul 03 01:13:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37ee4583-6018-47bb-979f-b9d9755bacc9 tempest-AttachVolumeShelveTestJSON-1558374533 None] Lock "cinder-b240c81f-76b4-470e-8ea2-2fe3ac3f85e4-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:26 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b" returned: 0 in 1.069s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:13:26 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b26d06-1059-4217-a6f3-281584aa154c]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:26 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 Jul 03 01:13:26 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:27 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356" returned: 0 in 1.018s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:27 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b Jul 03 01:13:27 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:13:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:27 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:13:27 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:28 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b" returned: 0 in 1.155s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:28 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b Jul 03 01:13:28 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:28 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.979s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:13:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:13:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:13:28 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Flow 'volume_create_manager' (6cf505ba-9d9b-41a9-a2ea-581b0c68ba11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f026e91d-24d9-4d24-b571-c4476a535059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f026e91d-24d9-4d24-b571-c4476a535059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-402247704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780c1b44-67e2-43ba-8966-d03626822197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6730c419b6a747438e1006a32dd4c204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:29Z,use_quota=True,user_id='a3f4d584fe9246b9b9b8e298fad5c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abac3df0-e9f6-467b-92b0-43bcca8eb7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abac3df0-e9f6-467b-92b0-43bcca8eb7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1986c4a-67e8-468f-92fa-e4493a0aa0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:29 devstack cinder-volume[86357]: DEBUG cinder.image.glance [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Creating Keystone auth plugin from conf {{(pid=86357) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:13:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1986c4a-67e8-468f-92fa-e4493a0aa0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '780c1b44-67e2-43ba-8966-d03626822197', 'volume_name': 'volume-780c1b44-67e2-43ba-8966-d03626822197', 'volume_size': 1, 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7645134c6d614f2bac5348098ce26f25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'created_at': datetime.datetime(2026, 7, 2, 22, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f112ba-fc79-4d9b-a592-c47f855909cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f112ba-fc79-4d9b-a592-c47f855909cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633508f5-3f52-465a-838c-17db5e43200e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:29 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Volume 780c1b44-67e2-43ba-8966-d03626822197: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-780c1b44-67e2-43ba-8966-d03626822197', 'volume_size': 1, 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7645134c6d614f2bac5348098ce26f25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'created_at': datetime.datetime(2026, 7, 2, 22, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 01:13:29 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Trying to clone 780c1b44-67e2-43ba-8966-d03626822197 from image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]). {{(pid=86357) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:13:29 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356.1fa655b4-b2d8-4227-a18a-27b5b5065d3b" returned: 0 in 1.116s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-1fa655b4-b2d8-4227-a18a-27b5b5065d3b" released by "_delete_snapshot" :: held 4.573s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-652d3d2d-d8a1-41d2-aff4-f0b59298d356" released by "delete_snapshot" :: held 4.606s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:30 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Created reservations ['13d80aec-fbcc-4f0b-b185-635e6b8e7794', '2927dd07-df0c-433a-9788-f896782e196a', 'ebaa7897-dffd-4267-a943-1d6579a6a8fc', '2c3ee7eb-edce-41f8-96d2-dfc2b0080b09'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:30 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:13:30 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Image download 20.69 MB at 20.69 MB/s Jul 03 01:13:30 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Delete snapshot completed successfully. Jul 03 01:13:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b074be04-9944-4ea7-91e9-717ad1b2487c tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-1fa655b4-b2d8-4227-a18a-27b5b5065d3b-delete_snapshot" released by "delete_snapshot" :: held 5.189s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:30 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bc1b6a-7c5d-430e-b4f9-fa60d4d1cfa6]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:30 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD Jul 03 01:13:30 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Flow 'volume_create_manager' (f41e1b77-972f-4201-8324-4564c2cd09d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5098914-6a41-4be3-9257-828f41c8e8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5098914-6a41-4be3-9257-828f41c8e8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1434541029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61bad0a-0d3e-44f4-8211-8fac8bbaff87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1275129ff042b4af5b63d62580c760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:31Z,use_quota=True,user_id='3e64b4ae851341d4938e29a2915dce2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aad9a8f-99fa-4627-8566-344896ef1144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aad9a8f-99fa-4627-8566-344896ef1144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d64a6e-83ca-4fc3-b649-a8409bca5b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:31 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d64a6e-83ca-4fc3-b649-a8409bca5b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61bad0a-0d3e-44f4-8211-8fac8bbaff87', 'volume_name': 'volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52276dd-3d23-45fc-9bc4-23068b62cf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52276dd-3d23-45fc-9bc4-23068b62cf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e65f1b3-fc2f-4ffa-b6a0-cbc966bead9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:31 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Volume f61bad0a-0d3e-44f4-8211-8fac8bbaff87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87', 'volume_size': 1} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1434541029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61bad0a-0d3e-44f4-8211-8fac8bbaff87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1275129ff042b4af5b63d62580c760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:31Z,use_quota=True,user_id='3e64b4ae851341d4938e29a2915dce2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Creating volume f61bad0a-0d3e-44f4-8211-8fac8bbaff87 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:31 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD" returned: 0 in 1.142s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Temporary image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd is fetched for user a3f4d584fe9246b9b9b8e298fad5c812. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:13:31 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 1073741824 Jul 03 01:13:31 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad3d99c-0424-4fc0-b3b3-c9302b61bb03]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:31 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD Jul 03 01:13:31 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:32 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 1073741824" returned: 0 in 1.125s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:32 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD" returned: 0 in 1.023s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:32 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 Jul 03 01:13:32 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:33 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87" returned: 0 in 0.766s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.799s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-402247704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780c1b44-67e2-43ba-8966-d03626822197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6730c419b6a747438e1006a32dd4c204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:29Z,use_quota=True,user_id='a3f4d584fe9246b9b9b8e298fad5c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Creating volume 780c1b44-67e2-43ba-8966-d03626822197 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:33 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e65f1b3-fc2f-4ffa-b6a0-cbc966bead9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:33 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 1073741824 Jul 03 01:13:33 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2310387e-6eb7-4877-a582-89cec999d794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:33 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Volume volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 (f61bad0a-0d3e-44f4-8211-8fac8bbaff87): created successfully Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2310387e-6eb7-4877-a582-89cec999d794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Flow 'volume_create_manager' (f41e1b77-972f-4201-8324-4564c2cd09d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:33 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-992061da-22d2-4df9-b9fb-f485703d3e81 tempest-VolumesSnapshotTestJSON-1076177584 None] Created volume successfully. Jul 03 01:13:34 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 1073741824" returned: 0 in 1.196s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:34 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 Jul 03 01:13:34 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:35 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197" returned: 0 in 0.830s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.483s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] Creating offline snapshot dff66737-4eda-4ef2-a859-721c56e27624 of volume f61bad0a-0d3e-44f4-8211-8fac8bbaff87 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:13:35 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3356bb18-d270-407d-8569-09537097feb2]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:35 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Attempting download of 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd ((None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}])) to volume 780c1b44-67e2-43ba-8966-d03626822197. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:13:35 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0072518b-5f8b-455b-b756-494c9e85faf0]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_kngsdjoj {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:35 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 Jul 03 01:13:35 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:35 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_kngsdjoj Jul 03 01:13:35 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:36 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87" returned: 0 in 1.117s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:36 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 1G Jul 03 01:13:36 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:36 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_kngsdjoj" returned: 0 in 1.117s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_kngsdjoj {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:36 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_kngsdjoj Jul 03 01:13:36 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:37 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 1G" returned: 0 in 1.131s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:37 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_kngsdjoj" returned: 1 in 1.069s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:37 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 Jul 03 01:13:37 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_kngsdjoj' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:13:37 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbb7389-038a-46c1-8bab-7729f97ca5ee]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:37 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD Jul 03 01:13:37 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:38 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624" returned: 0 in 0.856s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:38 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 is being set with open permissions: ugo+rw Jul 03 01:13:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:38 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 Jul 03 01:13:38 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD" returned: 0 in 0.939s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:38 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd was qcow2, converting to raw {{(pid=86357) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:13:38 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:38 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 Jul 03 01:13:38 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:39 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624" returned: 0 in 1.134s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:39 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=105,cinder:UPDATE=128,cinder:DELETE=10,cinder:INSERT=31 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:13:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:39 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.info Jul 03 01:13:39 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:40 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.info" returned: 0 in 1.059s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:40 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.info is being set with open permissions: ugo+rw Jul 03 01:13:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:40 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.info Jul 03 01:13:40 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:41 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197" returned: 0 in 2.838s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:41 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_16io3m2fdevstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:13:41 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Converted 112.00 MB image at 39.44 MB/s Jul 03 01:13:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:41 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 1G Jul 03 01:13:41 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:41 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.info" returned: 0 in 0.918s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.380s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:41 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-839dc4ed-601a-412a-b05a-0ea614ad3f32 tempest-VolumesSnapshotTestJSON-1076177584 None] Create snapshot completed successfully Jul 03 01:13:42 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 1G" returned: 0 in 0.865s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:42 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1f3ac4-a1d1-4eb0-9254-fb77ed293c08]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:42 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 Jul 03 01:13:42 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Flow 'volume_create_manager' (a5318b8c-6ea6-4768-81c2-3e37624b1b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fe2af8-0a16-4055-904a-da0eafc19a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fe2af8-0a16-4055-904a-da0eafc19a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-983929330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c52f46-c1d9-4f97-93b3-2e230202ee32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1275129ff042b4af5b63d62580c760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=dff66737-4eda-4ef2-a859-721c56e27624,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:43Z,use_quota=True,user_id='3e64b4ae851341d4938e29a2915dce2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb8122a-47d7-4e7e-936e-73f83ed003a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb8122a-47d7-4e7e-936e-73f83ed003a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4252201-8c97-47be-aaed-967a6db0606e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4252201-8c97-47be-aaed-967a6db0606e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '18c52f46-c1d9-4f97-93b3-2e230202ee32', 'volume_name': 'volume-18c52f46-c1d9-4f97-93b3-2e230202ee32', 'volume_size': 2, 'snapshot_id': 'dff66737-4eda-4ef2-a859-721c56e27624'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630b0a9a-3272-4890-b1f2-cc9f0826b97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630b0a9a-3272-4890-b1f2-cc9f0826b97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db422b9-19f1-4c57-a36d-a6ef6f3659fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:43 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Volume 18c52f46-c1d9-4f97-93b3-2e230202ee32: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-18c52f46-c1d9-4f97-93b3-2e230202ee32', 'volume_size': 2, 'snapshot_id': 'dff66737-4eda-4ef2-a859-721c56e27624'} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-dff66737-4eda-4ef2-a859-721c56e27624-18c52f46-c1d9-4f97-93b3-2e230202ee32" by "_create_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-dff66737-4eda-4ef2-a859-721c56e27624-18c52f46-c1d9-4f97-93b3-2e230202ee32" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Creating volume 18c52f46-c1d9-4f97-93b3-2e230202ee32 from snapshot dff66737-4eda-4ef2-a859-721c56e27624 {{(pid=86357) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-18c52f46-c1d9-4f97-93b3-2e230202ee32" by "_copy_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:43 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197" returned: 0 in 0.987s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-18c52f46-c1d9-4f97-93b3-2e230202ee32" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] snapshot: dff66737-4eda-4ef2-a859-721c56e27624, volume: 18c52f46-c1d9-4f97-93b3-2e230202ee32, {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e8b7e9-9f49-4349-9a55-695f5520500f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:43 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 Jul 03 01:13:43 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:43 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 Jul 03 01:13:43 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:44 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624" returned: 0 in 0.982s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Creating direct copy from snapshot {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b9c67c-1eb9-48a2-ba3a-9bef6c41a1f8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:44 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 Jul 03 01:13:44 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:44 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197" returned: 1 in 1.350s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Downloaded image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd ((None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}])) to volume 780c1b44-67e2-43ba-8966-d03626822197 successfully. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Temporary image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd for user a3f4d584fe9246b9b9b8e298fad5c812 is deleted. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Marking volume 780c1b44-67e2-43ba-8966-d03626822197 as bootable. {{(pid=86357) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Copying metadata from image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd to 780c1b44-67e2-43ba-8966-d03626822197. {{(pid=86357) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Creating volume glance metadata for volume 780c1b44-67e2-43ba-8966-d03626822197 backed by image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86357) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633508f5-3f52-465a-838c-17db5e43200e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780c1b44-67e2-43ba-8966-d03626822197', 'volume_size': 1, 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7645134c6d614f2bac5348098ce26f25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'created_at': datetime.datetime(2026, 7, 2, 22, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce212a9-4af6-495d-bd2f-0109e98d9ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:44 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Volume volume-780c1b44-67e2-43ba-8966-d03626822197 (780c1b44-67e2-43ba-8966-d03626822197): created successfully Jul 03 01:13:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce212a9-4af6-495d-bd2f-0109e98d9ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Flow 'volume_create_manager' (6cf505ba-9d9b-41a9-a2ea-581b0c68ba11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:45 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-2af93db0-3893-41fe-9426-e669376e50de tempest-VolumesExtendTest-587700120 None] Created volume successfully. Jul 03 01:13:45 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87" returned: 0 in 0.950s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:45 devstack cinder-volume[86357]: DEBUG cinder.utils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Path /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32 not found in is_blk_device check {{(pid=86357) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:13:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:45 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32 Jul 03 01:13:45 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a7d3246c-f4a3-4178-9b76-8c360bc19df6 tempest-VolumesExtendTest-587700120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:51 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32" returned: 0 in 6.374s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:51 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[72db3c83-adb5-4dc2-ba8a-c88f2f9efeda]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:52 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 Jul 03 01:13:52 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:53 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87" returned: 0 in 1.112s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:53 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:13:53 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Converted 1024.00 MB image at 160.64 MB/s Jul 03 01:13:53 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32 is being set with open permissions: ugo+rw Jul 03 01:13:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:53 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32 Jul 03 01:13:53 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:53 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32" returned: 0 in 0.868s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-18c52f46-c1d9-4f97-93b3-2e230202ee32" released by "_copy_volume_from_snapshot" :: held 10.421s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-dff66737-4eda-4ef2-a859-721c56e27624-18c52f46-c1d9-4f97-93b3-2e230202ee32" released by "_create_volume_from_snapshot" :: held 10.471s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.487s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a7d3246c-f4a3-4178-9b76-8c360bc19df6 tempest-VolumesExtendTest-587700120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 8.148s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db422b9-19f1-4c57-a36d-a6ef6f3659fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18c52f46-c1d9-4f97-93b3-2e230202ee32', 'volume_size': 2, 'snapshot_id': 'dff66737-4eda-4ef2-a859-721c56e27624'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5a48c8-59db-4311-9dec-dbac56be09a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:53 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd31a4a-7b41-476c-b423-1f24a2a97e92]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a7d3246c-f4a3-4178-9b76-8c360bc19df6 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:54 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Volume volume-18c52f46-c1d9-4f97-93b3-2e230202ee32 (18c52f46-c1d9-4f97-93b3-2e230202ee32): created successfully Jul 03 01:13:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5a48c8-59db-4311-9dec-dbac56be09a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Flow 'volume_create_manager' (a5318b8c-6ea6-4768-81c2-3e37624b1b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:54 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-eddb2122-2c50-45c0-8ceb-8506706d6efd tempest-VolumesSnapshotTestJSON-1076177584 None] Created volume successfully. Jul 03 01:13:54 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 Jul 03 01:13:54 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:54 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-18c52f46-c1d9-4f97-93b3-2e230202ee32-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:54 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-18c52f46-c1d9-4f97-93b3-2e230202ee32-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:54 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-18c52f46-c1d9-4f97-93b3-2e230202ee32" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:54 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-18c52f46-c1d9-4f97-93b3-2e230202ee32" acquired by "delete_volume" :: waited 0.035s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:54 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c10b58-1367-41aa-933b-3cf7a6b98662]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:54 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32 Jul 03 01:13:54 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:55 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a7d3246c-f4a3-4178-9b76-8c360bc19df6 tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197" returned: 0 in 1.113s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a7d3246c-f4a3-4178-9b76-8c360bc19df6 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:55 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 Jul 03 01:13:55 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:55 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32" returned: 0 in 1.075s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:55 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32 Jul 03 01:13:55 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:55 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a7d3246c-f4a3-4178-9b76-8c360bc19df6 tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197" returned: 1 in 0.866s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a7d3246c-f4a3-4178-9b76-8c360bc19df6 tempest-VolumesExtendTest-587700120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:13:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a7d3246c-f4a3-4178-9b76-8c360bc19df6 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 2G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a7d3246c-f4a3-4178-9b76-8c360bc19df6 tempest-VolumesExtendTest-587700120 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 2G" returned: 0 in 0.117s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a7d3246c-f4a3-4178-9b76-8c360bc19df6 tempest-VolumesExtendTest-587700120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.175s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:56 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a7d3246c-f4a3-4178-9b76-8c360bc19df6 tempest-VolumesExtendTest-587700120 None] Extend volume completed successfully. Jul 03 01:13:56 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-18c52f46-c1d9-4f97-93b3-2e230202ee32" returned: 0 in 0.923s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:56 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-18c52f46-c1d9-4f97-93b3-2e230202ee32" released by "delete_volume" :: held 2.088s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:56 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Created reservations ['90f5a42a-22a0-48bc-87b2-6fde034635a6', '70e70b68-2019-4757-928e-543b4b18bb1e', 'fb4d87c5-8a79-42c5-a43e-4b690253a203', 'fe755929-c55d-493b-b3a3-d1746be8ff2d'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:56 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:13:56 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Acquiring lock "cinder-780c1b44-67e2-43ba-8966-d03626822197-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Lock "cinder-780c1b44-67e2-43ba-8966-d03626822197-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Acquiring lock "cinder-quobyte-780c1b44-67e2-43ba-8966-d03626822197" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Lock "cinder-quobyte-780c1b44-67e2-43ba-8966-d03626822197" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:57 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[980c479a-1386-473c-a2b6-6f569de42728]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:57 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 Jul 03 01:13:57 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:57 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.827s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:57 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:57 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Deleted volume successfully. Jul 03 01:13:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5d2c9a64-01d3-43e1-85d2-dc9fd321543b tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-18c52f46-c1d9-4f97-93b3-2e230202ee32-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-dff66737-4eda-4ef2-a859-721c56e27624-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-dff66737-4eda-4ef2-a859-721c56e27624-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-f61bad0a-0d3e-44f4-8211-8fac8bbaff87" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-f61bad0a-0d3e-44f4-8211-8fac8bbaff87" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-dff66737-4eda-4ef2-a859-721c56e27624" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-dff66737-4eda-4ef2-a859-721c56e27624" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Deleting offline snapshot dff66737-4eda-4ef2-a859-721c56e27624 of volume f61bad0a-0d3e-44f4-8211-8fac8bbaff87 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:13:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] snapshot_file for this snap is: volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:13:58 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a29516-f687-42c0-8012-ae6d7006d285]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:58 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 Jul 03 01:13:58 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:58 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197" returned: 0 in 1.010s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:58 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 Jul 03 01:13:58 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:58 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624" returned: 0 in 0.887s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:13:59 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff52fc6-07ed-4687-9693-2c571770e07b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:59 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 Jul 03 01:13:59 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:59 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197" returned: 1 in 0.968s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:13:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:59 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197 Jul 03 01:13:59 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:59 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87" returned: 0 in 0.880s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:59 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 Jul 03 01:13:59 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:00 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-780c1b44-67e2-43ba-8966-d03626822197" returned: 0 in 0.735s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Lock "cinder-quobyte-780c1b44-67e2-43ba-8966-d03626822197" released by "delete_volume" :: held 2.800s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:00 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Created reservations ['1ff275dd-d985-4a79-90ed-cca30ff1ceeb', '30331283-0469-4b38-a8f0-1bd05621f5f7', '783dc054-3d8b-4d9b-b361-c9280986dcee', '1e25bfca-6736-463f-a1df-e1422cd7f7b0'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:00 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:14:00 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:00 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624" returned: 0 in 1.069s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:01 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624 Jul 03 01:14:01 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:14:01 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Flow 'volume_create_manager' (4092a946-9e3c-4a4c-8832-f8c65c2030b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2592fbd-f238-474a-b970-a3a89b79efa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.281s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:14:01 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Deleted volume successfully. Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2592fbd-f238-474a-b970-a3a89b79efa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1043590735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeb1e46-5409-42d9-8d5c-ec65e6aefa17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6730c419b6a747438e1006a32dd4c204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:02Z,use_quota=True,user_id='a3f4d584fe9246b9b9b8e298fad5c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b1e178-be20-4656-994e-647867a147e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b1e178-be20-4656-994e-647867a147e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0111c1f-389f-4121-af25-0209e60a7140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0111c1f-389f-4121-af25-0209e60a7140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eeb1e46-5409-42d9-8d5c-ec65e6aefa17', 'volume_name': 'volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0632fd3-2986-43b1-9673-584ee506be66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0632fd3-2986-43b1-9673-584ee506be66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2acf56a-bbb2-4dfe-86cb-f049b8de2c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:01 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Volume 2eeb1e46-5409-42d9-8d5c-ec65e6aefa17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17', 'volume_size': 1} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1043590735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeb1e46-5409-42d9-8d5c-ec65e6aefa17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6730c419b6a747438e1006a32dd4c204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:02Z,use_quota=True,user_id='a3f4d584fe9246b9b9b8e298fad5c812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Creating volume 2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:14:01 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-991d4932-77ef-45ec-b829-6cc246102d25 tempest-VolumesExtendTest-587700120 None] Lock "cinder-780c1b44-67e2-43ba-8966-d03626822197-delete_volume" released by "delete_volume" :: held 4.466s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:01 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 1073741824 Jul 03 01:14:01 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:02 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87.dff66737-4eda-4ef2-a859-721c56e27624" returned: 0 in 1.031s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-dff66737-4eda-4ef2-a859-721c56e27624" released by "_delete_snapshot" :: held 4.026s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-f61bad0a-0d3e-44f4-8211-8fac8bbaff87" released by "delete_snapshot" :: held 4.058s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:02 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Created reservations ['e8b9c353-ed2d-4963-bfb0-9332a0befcfd', '3ba126d2-c738-4a0b-aae0-c1b231a72d62', 'd5e931e2-8567-415e-ac25-f163fe20b709', 'cf19f8fe-04fa-45f9-b181-2ca660a02c01'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:02 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Delete snapshot completed successfully. Jul 03 01:14:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1deea0f4-6e4e-4588-92f1-97cf77ddf72e tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-dff66737-4eda-4ef2-a859-721c56e27624-delete_snapshot" released by "delete_snapshot" :: held 4.386s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:03 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 1073741824" returned: 0 in 1.230s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:03 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 Jul 03 01:14:03 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-f61bad0a-0d3e-44f4-8211-8fac8bbaff87-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-f61bad0a-0d3e-44f4-8211-8fac8bbaff87-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-f61bad0a-0d3e-44f4-8211-8fac8bbaff87" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-f61bad0a-0d3e-44f4-8211-8fac8bbaff87" acquired by "delete_volume" :: waited 0.034s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:03 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e8b71d-4384-4e1e-ad17-dde2c4614ee1]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:03 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 Jul 03 01:14:03 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:04 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17" returned: 0 in 0.989s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] <== create_volume: return (2293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:14:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.295s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2acf56a-bbb2-4dfe-86cb-f049b8de2c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6647db11-7349-4497-b7c7-d4262adfa496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:04 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Volume volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 (2eeb1e46-5409-42d9-8d5c-ec65e6aefa17): created successfully Jul 03 01:14:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6647db11-7349-4497-b7c7-d4262adfa496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Flow 'volume_create_manager' (4092a946-9e3c-4a4c-8832-f8c65c2030b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:04 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d2c18b6d-8979-490c-be7d-851e72bea837 tempest-VolumesExtendTest-587700120 None] Created volume successfully. Jul 03 01:14:04 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87" returned: 0 in 0.848s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:04 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87 Jul 03 01:14:04 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] Creating offline snapshot 53231b36-d482-43c6-ba9c-b0db8e977519 of volume 2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b7b181-7497-4332-ba34-f4d76ce28e89]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:05 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 Jul 03 01:14:05 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:05 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f61bad0a-0d3e-44f4-8211-8fac8bbaff87" returned: 0 in 0.716s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-f61bad0a-0d3e-44f4-8211-8fac8bbaff87" released by "delete_volume" :: held 1.681s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Created reservations ['90b6f26d-b1ad-4048-961d-9593069f266e', '27ab6d68-c05b-4d5f-8d0d-b6eb2c037d58', 'aa63934b-3704-4830-8a48-c164afc104b6', '231e1fff-724a-4762-ac8f-55bb26426794'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:05 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:14:05 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:05 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17" returned: 0 in 0.854s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:05 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 1G Jul 03 01:14:05 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:06 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.894s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:14:06 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Deleted volume successfully. Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-31e1888c-a116-4282-8dd9-da5647c3d196 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-f61bad0a-0d3e-44f4-8211-8fac8bbaff87-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Flow 'volume_create_manager' (46be9c19-1262-44a3-ba31-19cb12814b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321f3dc7-bb9a-432b-8a41-afdc982de5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321f3dc7-bb9a-432b-8a41-afdc982de5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1488046110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd48aec-7998-4b6f-8564-ca205bf3ba40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1275129ff042b4af5b63d62580c760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:07Z,use_quota=True,user_id='3e64b4ae851341d4938e29a2915dce2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d572c799-f927-427b-9c43-5cb3ae386e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d572c799-f927-427b-9c43-5cb3ae386e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04903192-ee5f-49bc-9ece-fdca35dfe45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04903192-ee5f-49bc-9ece-fdca35dfe45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dd48aec-7998-4b6f-8564-ca205bf3ba40', 'volume_name': 'volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438e3d31-db4a-46cf-9ecd-bd60d6af65f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438e3d31-db4a-46cf-9ecd-bd60d6af65f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab538019-6ee1-474e-ad39-91a5f659d7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:06 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Volume 1dd48aec-7998-4b6f-8564-ca205bf3ba40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40', 'volume_size': 1} Jul 03 01:14:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:07 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 1G" returned: 0 in 1.097s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:07 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 Jul 03 01:14:07 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:07 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519" returned: 0 in 0.672s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:07 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 is being set with open permissions: ugo+rw Jul 03 01:14:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:07 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 Jul 03 01:14:07 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:08 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519" returned: 0 in 0.648s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:08 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.info Jul 03 01:14:08 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:09 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.info" returned: 0 in 0.924s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:09 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.info is being set with open permissions: ugo+rw Jul 03 01:14:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:09 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.info Jul 03 01:14:09 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:10 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.info" returned: 0 in 1.319s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.625s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.889s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1488046110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd48aec-7998-4b6f-8564-ca205bf3ba40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1275129ff042b4af5b63d62580c760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:07Z,use_quota=True,user_id='3e64b4ae851341d4938e29a2915dce2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:14:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Creating volume 1dd48aec-7998-4b6f-8564-ca205bf3ba40 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:14:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:14:10 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:14:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:10 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 1073741824 Jul 03 01:14:10 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:10 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-2ba2970d-5796-4f73-8749-a1194941480a tempest-VolumesExtendTest-587700120 None] Create snapshot completed successfully Jul 03 01:14:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-617569e5-bc07-46fa-8f28-61bc570ab498 tempest-VolumesExtendTest-587700120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:12 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 1073741824" returned: 0 in 1.736s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:12 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 Jul 03 01:14:12 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:13 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40" returned: 0 in 0.902s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] <== create_volume: return (2722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:14:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.742s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-617569e5-bc07-46fa-8f28-61bc570ab498 tempest-VolumesExtendTest-587700120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.621s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab538019-6ee1-474e-ad39-91a5f659d7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765431ed-15d6-4714-8c9d-acb2dae5710f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:13 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[688baf47-2a64-4f92-8a91-34668098e113]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-617569e5-bc07-46fa-8f28-61bc570ab498 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:13 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Volume volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 (1dd48aec-7998-4b6f-8564-ca205bf3ba40): created successfully Jul 03 01:14:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765431ed-15d6-4714-8c9d-acb2dae5710f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Flow 'volume_create_manager' (46be9c19-1262-44a3-ba31-19cb12814b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-163fd9b4-f86f-4d0a-a987-73de835a437b tempest-VolumesSnapshotTestJSON-1076177584 None] Created volume successfully. Jul 03 01:14:13 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 Jul 03 01:14:13 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:14 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-617569e5-bc07-46fa-8f28-61bc570ab498 tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17" returned: 0 in 1.119s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-617569e5-bc07-46fa-8f28-61bc570ab498 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 2G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-617569e5-bc07-46fa-8f28-61bc570ab498 tempest-VolumesExtendTest-587700120 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 2G" returned: 0 in 0.187s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-617569e5-bc07-46fa-8f28-61bc570ab498 tempest-VolumesExtendTest-587700120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.387s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.141s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:14 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=100,cinder:DELETE=8,cinder:SELECT=99,cinder:INSERT=33 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:14:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] Creating offline snapshot 4680846c-96fe-4c64-80c4-95b1a67ae35f of volume 1dd48aec-7998-4b6f-8564-ca205bf3ba40 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:14:14 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[5790cc40-931b-4492-9221-8178070e0856]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:14 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-617569e5-bc07-46fa-8f28-61bc570ab498 tempest-VolumesExtendTest-587700120 None] Extend volume completed successfully. Jul 03 01:14:14 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 Jul 03 01:14:14 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Acquiring lock "cinder-53231b36-d482-43c6-ba9c-b0db8e977519-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Lock "cinder-53231b36-d482-43c6-ba9c-b0db8e977519-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Acquiring lock "cinder-quobyte-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Lock "cinder-quobyte-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Acquiring lock "cinder-quobyte-53231b36-d482-43c6-ba9c-b0db8e977519" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Lock "cinder-quobyte-53231b36-d482-43c6-ba9c-b0db8e977519" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Deleting offline snapshot 53231b36-d482-43c6-ba9c-b0db8e977519 of volume 2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:14:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] snapshot_file for this snap is: volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:14:15 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd6f021-8151-4500-8b11-5b7ad03e9606]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:15 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40" returned: 0 in 0.939s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:15 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 Jul 03 01:14:15 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:15 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f 1G Jul 03 01:14:15 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:16 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519" returned: 0 in 1.086s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:14:16 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1be1f1-9ed8-4d40-b72a-fc7b89ec51a7]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:16 devstack sudo[94657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 Jul 03 01:14:16 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:16 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f 1G" returned: 0 in 1.093s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:16 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f Jul 03 01:14:16 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:17 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17" returned: 0 in 0.894s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:17 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f" returned: 0 in 0.739s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:17 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f is being set with open permissions: ugo+rw Jul 03 01:14:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:17 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 Jul 03 01:14:17 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:17 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f Jul 03 01:14:17 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:19 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f" returned: 0 in 1.670s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:19 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.info Jul 03 01:14:19 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:19 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519" returned: 0 in 1.832s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:19 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519 Jul 03 01:14:19 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:20 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17.53231b36-d482-43c6-ba9c-b0db8e977519" returned: 0 in 0.988s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Lock "cinder-quobyte-53231b36-d482-43c6-ba9c-b0db8e977519" released by "_delete_snapshot" :: held 4.977s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:20 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Lock "cinder-quobyte-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17" released by "delete_snapshot" :: held 5.027s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.info" returned: 0 in 1.163s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:20 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.info is being set with open permissions: ugo+rw Jul 03 01:14:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:20 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.info Jul 03 01:14:20 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:20 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Created reservations ['12a1a86f-ad40-47d0-a2b9-db20eb3b58dc', 'da321131-e78d-46f2-a1f1-b38d1aa82fe1', '9f6e14d5-b464-44a0-8c02-0c7871c1a4f1', 'bc041d92-b83f-4990-ac37-e6de4b4f8b27'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:20 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Delete snapshot completed successfully. Jul 03 01:14:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66062b39-cd83-4fdf-8cac-f7d46bf0ae56 tempest-VolumesExtendTest-587700120 None] Lock "cinder-53231b36-d482-43c6-ba9c-b0db8e977519-delete_snapshot" released by "delete_snapshot" :: held 5.363s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Acquiring lock "cinder-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Lock "cinder-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Acquiring lock "cinder-quobyte-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Lock "cinder-quobyte-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:21 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[96549970-40ba-4b00-b6cc-5bb0c145f14c]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:21 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 Jul 03 01:14:21 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:21 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.info" returned: 0 in 1.194s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.982s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:21 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a3b01cad-6ec9-4241-881e-68007c98b48c tempest-VolumesSnapshotTestJSON-1076177584 None] Create snapshot completed successfully Jul 03 01:14:22 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17" returned: 0 in 1.481s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:22 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17 Jul 03 01:14:22 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Flow 'volume_create_manager' (6cfbcde8-399f-46b3-9855-f96d7f9c1a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47a174a-36d8-411b-9c5f-299a073c86f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47a174a-36d8-411b-9c5f-299a073c86f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-936969117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=679c4d71-4b9f-4bf3-9da9-03105320ed1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1275129ff042b4af5b63d62580c760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4680846c-96fe-4c64-80c4-95b1a67ae35f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:23Z,use_quota=True,user_id='3e64b4ae851341d4938e29a2915dce2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84493c5-3a1e-4f87-8fef-6473d47b6593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84493c5-3a1e-4f87-8fef-6473d47b6593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7f39cd-f5b5-47e4-88fe-8bbadd20bd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7f39cd-f5b5-47e4-88fe-8bbadd20bd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '679c4d71-4b9f-4bf3-9da9-03105320ed1d', 'volume_name': 'volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d', 'volume_size': 1, 'snapshot_id': '4680846c-96fe-4c64-80c4-95b1a67ae35f'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac01138-0820-4c28-985e-c10c94a3c220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac01138-0820-4c28-985e-c10c94a3c220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdb55a5-e42a-4efc-8da1-76bcbef81aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:23 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Volume 679c4d71-4b9f-4bf3-9da9-03105320ed1d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d', 'volume_size': 1, 'snapshot_id': '4680846c-96fe-4c64-80c4-95b1a67ae35f'} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-4680846c-96fe-4c64-80c4-95b1a67ae35f-679c4d71-4b9f-4bf3-9da9-03105320ed1d" by "_create_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-4680846c-96fe-4c64-80c4-95b1a67ae35f-679c4d71-4b9f-4bf3-9da9-03105320ed1d" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Creating volume 679c4d71-4b9f-4bf3-9da9-03105320ed1d from snapshot 4680846c-96fe-4c64-80c4-95b1a67ae35f {{(pid=86357) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-679c4d71-4b9f-4bf3-9da9-03105320ed1d" by "_copy_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-679c4d71-4b9f-4bf3-9da9-03105320ed1d" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] snapshot: 4680846c-96fe-4c64-80c4-95b1a67ae35f, volume: 679c4d71-4b9f-4bf3-9da9-03105320ed1d, {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f9fdd6-5b43-49d0-aaf1-1b46f72cd240]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Flow 'volume_create_manager' (64190936-875c-460b-8da8-be23cfa7b7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08d06f6-9183-4f68-9e70-aa8081eb4965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08d06f6-9183-4f68-9e70-aa8081eb4965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-455625157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e8c802-b0da-4df9-8a7f-759cae941208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbd3f898a634ebcaad2dc0cd251d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:24Z,use_quota=True,user_id='2806b68b55b64323b29b70fb50a385fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd4c0e1-c818-4f20-b556-ef4183232a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd4c0e1-c818-4f20-b556-ef4183232a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:23 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f Jul 03 01:14:23 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0772d07-45e4-412e-9ab2-4182e4d0c7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0772d07-45e4-412e-9ab2-4182e4d0c7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e8c802-b0da-4df9-8a7f-759cae941208', 'volume_name': 'volume-75e8c802-b0da-4df9-8a7f-759cae941208', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11462fe0-e42d-41e5-9cb4-a1023307a86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11462fe0-e42d-41e5-9cb4-a1023307a86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8cff2b-d458-42a3-9e8a-bdedadecbe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:23 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Volume 75e8c802-b0da-4df9-8a7f-759cae941208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e8c802-b0da-4df9-8a7f-759cae941208', 'volume_size': 1} Jul 03 01:14:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:24 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17" returned: 0 in 1.226s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Lock "cinder-quobyte-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17" released by "delete_volume" :: held 2.821s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Created reservations ['4666c2ec-6709-4e63-98d6-0a0b881a9e98', '2eee404a-a8aa-40a9-adb6-b1fcb7cd3324', '415cd67d-d118-424f-8821-7ac77c607ae9', '436342d0-e185-4936-8ef4-da490a005951'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:24 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:14:24 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:24 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f" returned: 0 in 1.063s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Creating direct copy from snapshot {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[250237b8-43a3-481e-bf60-20d95b0707b6]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:24 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 Jul 03 01:14:24 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:25 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.835s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:25 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:14:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Deleted volume successfully. Jul 03 01:14:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cad112d5-3e93-49ec-abc1-d33f6fa9243b tempest-VolumesExtendTest-587700120 None] Lock "cinder-2eeb1e46-5409-42d9-8d5c-ec65e6aefa17-delete_volume" released by "delete_volume" :: held 3.956s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:25 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40" returned: 0 in 0.892s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:25 devstack cinder-volume[86357]: DEBUG cinder.utils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Path /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d not found in is_blk_device check {{(pid=86357) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:14:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:25 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d Jul 03 01:14:25 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:14:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:27 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:14:27 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:30 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 2.623s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:30 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:14:30 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:14:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:14:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:14:31 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:14:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Flow 'volume_create_manager' (a0ea0bf6-477f-4da0-bb8f-068bbc28fc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f190e534-8d16-42f8-9f60-a2aad92f0c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f190e534-8d16-42f8-9f60-a2aad92f0c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1485553373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a80fb5-d0db-4d41-9f1a-44631a5c08fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82849475249433ba8146674cd9a4aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:31Z,use_quota=True,user_id='2aabd130593840b4aca2553b628c2fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc3ee7b-4802-4abc-aca6-5b9d3f96a701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc3ee7b-4802-4abc-aca6-5b9d3f96a701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35afd14b-26df-4138-a1da-c67a829d8e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35afd14b-26df-4138-a1da-c67a829d8e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a80fb5-d0db-4d41-9f1a-44631a5c08fc', 'volume_name': 'volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca4d236-a128-43e0-9f0a-8c31a4b32c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca4d236-a128-43e0-9f0a-8c31a4b32c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7276eecd-49b3-43a7-bc87-a318c3c226af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:31 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Volume a0a80fb5-d0db-4d41-9f1a-44631a5c08fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc', 'volume_size': 1} Jul 03 01:14:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:33 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d" returned: 0 in 7.956s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:33 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7fb381-738b-4124-80d3-e119d40a714d]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:33 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 Jul 03 01:14:33 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:34 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40" returned: 0 in 1.037s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:34 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40, size 1024.00 MB, duration 7.96 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:14:34 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Converted 1024.00 MB image at 128.66 MB/s Jul 03 01:14:34 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d is being set with open permissions: ugo+rw Jul 03 01:14:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:34 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d Jul 03 01:14:34 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:34 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:14:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Flow 'volume_create_manager' (80f9184f-3af8-45e7-ae8a-5a7c3ea26933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0fb584-d086-40c6-a5d9-72bcc4365f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0fb584-d086-40c6-a5d9-72bcc4365f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1586108811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8bda29-e01e-488e-8aaf-614029ec6468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4e13c0646e41cdbdfe478d955db0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:35Z,use_quota=True,user_id='8e6f73bbb55c4c499e6b2be6cd2e7ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2ede95-d243-4d01-9cf3-e6895c69debc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2ede95-d243-4d01-9cf3-e6895c69debc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3652c1e7-e5b6-4c5e-98d6-2a0e7b7ed646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3652c1e7-e5b6-4c5e-98d6-2a0e7b7ed646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe8bda29-e01e-488e-8aaf-614029ec6468', 'volume_name': 'volume-fe8bda29-e01e-488e-8aaf-614029ec6468', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5db27c-dcb3-4b6a-92e9-3196138d5863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5db27c-dcb3-4b6a-92e9-3196138d5863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9369b743-c514-4862-bb07-360606363c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:35 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Volume fe8bda29-e01e-488e-8aaf-614029ec6468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe8bda29-e01e-488e-8aaf-614029ec6468', 'volume_size': 1} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:35 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d" returned: 0 in 0.676s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-679c4d71-4b9f-4bf3-9da9-03105320ed1d" released by "_copy_volume_from_snapshot" :: held 11.791s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-4680846c-96fe-4c64-80c4-95b1a67ae35f-679c4d71-4b9f-4bf3-9da9-03105320ed1d" released by "_create_volume_from_snapshot" :: held 11.831s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.853s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.449s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-455625157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e8c802-b0da-4df9-8a7f-759cae941208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbd3f898a634ebcaad2dc0cd251d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:24Z,use_quota=True,user_id='2806b68b55b64323b29b70fb50a385fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Creating volume 75e8c802-b0da-4df9-8a7f-759cae941208 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:14:35 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-75e8c802-b0da-4df9-8a7f-759cae941208 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:35 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-75e8c802-b0da-4df9-8a7f-759cae941208 1073741824 Jul 03 01:14:35 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdb55a5-e42a-4efc-8da1-76bcbef81aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d', 'volume_size': 1, 'snapshot_id': '4680846c-96fe-4c64-80c4-95b1a67ae35f'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c18dcb-a5a1-4edf-9cd5-4de52ce79948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:35 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Volume volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d (679c4d71-4b9f-4bf3-9da9-03105320ed1d): created successfully Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c18dcb-a5a1-4edf-9cd5-4de52ce79948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Flow 'volume_create_manager' (6cfbcde8-399f-46b3-9855-f96d7f9c1a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:35 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-0e2e83c3-5f09-4ad1-b8f3-78c3e9ef0ad9 tempest-VolumesSnapshotTestJSON-1076177584 None] Created volume successfully. Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-679c4d71-4b9f-4bf3-9da9-03105320ed1d-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-679c4d71-4b9f-4bf3-9da9-03105320ed1d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-679c4d71-4b9f-4bf3-9da9-03105320ed1d" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-679c4d71-4b9f-4bf3-9da9-03105320ed1d" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[967579fc-c0a4-4cb3-862e-5e6fbab74a71]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:36 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d Jul 03 01:14:36 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:36 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-75e8c802-b0da-4df9-8a7f-759cae941208 1073741824" returned: 0 in 0.841s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-75e8c802-b0da-4df9-8a7f-759cae941208 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:36 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-75e8c802-b0da-4df9-8a7f-759cae941208 Jul 03 01:14:36 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:36 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d" returned: 0 in 0.781s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:36 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d Jul 03 01:14:36 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:36 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-75e8c802-b0da-4df9-8a7f-759cae941208" returned: 0 in 0.621s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.565s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1485553373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a80fb5-d0db-4d41-9f1a-44631a5c08fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82849475249433ba8146674cd9a4aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:31Z,use_quota=True,user_id='2aabd130593840b4aca2553b628c2fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Creating volume a0a80fb5-d0db-4d41-9f1a-44631a5c08fc {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:14:36 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:36 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc 1073741824 Jul 03 01:14:36 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8cff2b-d458-42a3-9e8a-bdedadecbe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e8c802-b0da-4df9-8a7f-759cae941208', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c4fb76-45e0-4fbc-9325-91c2d0f4d634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:36 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Volume volume-75e8c802-b0da-4df9-8a7f-759cae941208 (75e8c802-b0da-4df9-8a7f-759cae941208): created successfully Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c4fb76-45e0-4fbc-9325-91c2d0f4d634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Flow 'volume_create_manager' (64190936-875c-460b-8da8-be23cfa7b7cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:36 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d2c29768-ebae-4952-973e-7e4482e29978 tempest-VolumesActionsTest-1559067197 None] Created volume successfully. Jul 03 01:14:37 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-679c4d71-4b9f-4bf3-9da9-03105320ed1d" returned: 0 in 0.707s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-679c4d71-4b9f-4bf3-9da9-03105320ed1d" released by "delete_volume" :: held 1.523s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Created reservations ['a7cbc06a-9505-44ce-8f13-98b35235fd9f', 'b738dbed-0446-48d4-b5da-0ec0b56baa47', '6108492d-4bdb-4510-a306-93400e351050', '4f822e0c-cfa9-4bd8-b805-ffc36f1079eb'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:37 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:14:37 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-26a38725-44fa-4333-88e2-3fe750c70d9c tempest-VolumesActionsTest-1559067197 None] Acquiring lock "cinder-75e8c802-b0da-4df9-8a7f-759cae941208" by "attach_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-26a38725-44fa-4333-88e2-3fe750c70d9c tempest-VolumesActionsTest-1559067197 None] Lock "cinder-75e8c802-b0da-4df9-8a7f-759cae941208" acquired by "attach_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:37 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-26a38725-44fa-4333-88e2-3fe750c70d9c tempest-VolumesActionsTest-1559067197 None] Attaching volume 75e8c802-b0da-4df9-8a7f-759cae941208 to instance 64a462a5-f770-449a-bc1a-20d445777575 at mountpoint /dev/vdb on host None. Jul 03 01:14:37 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc 1073741824" returned: 0 in 0.898s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:37 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-26a38725-44fa-4333-88e2-3fe750c70d9c tempest-VolumesActionsTest-1559067197 None] Attach volume completed successfully. Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-26a38725-44fa-4333-88e2-3fe750c70d9c tempest-VolumesActionsTest-1559067197 None] Lock "cinder-75e8c802-b0da-4df9-8a7f-759cae941208" released by "attach_volume" :: held 0.112s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:37 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc Jul 03 01:14:37 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-4680846c-96fe-4c64-80c4-95b1a67ae35f-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-4680846c-96fe-4c64-80c4-95b1a67ae35f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-1dd48aec-7998-4b6f-8564-ca205bf3ba40" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-1dd48aec-7998-4b6f-8564-ca205bf3ba40" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-4680846c-96fe-4c64-80c4-95b1a67ae35f" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-4680846c-96fe-4c64-80c4-95b1a67ae35f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Deleting offline snapshot 4680846c-96fe-4c64-80c4-95b1a67ae35f of volume 1dd48aec-7998-4b6f-8564-ca205bf3ba40 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] snapshot_file for this snap is: volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade83d79-e917-4eca-a8d5-f804a3bcba0f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:38 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.766s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:14:38 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Deleted volume successfully. Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6b0e572b-65f4-4ebd-8341-55bb42f90e63 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-679c4d71-4b9f-4bf3-9da9-03105320ed1d-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:38 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f Jul 03 01:14:38 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:38 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" returned: 0 in 0.662s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.497s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1586108811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8bda29-e01e-488e-8aaf-614029ec6468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4e13c0646e41cdbdfe478d955db0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:35Z,use_quota=True,user_id='8e6f73bbb55c4c499e6b2be6cd2e7ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Creating volume fe8bda29-e01e-488e-8aaf-614029ec6468 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:14:38 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:38 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468 1073741824 Jul 03 01:14:38 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7276eecd-49b3-43a7-bc87-a318c3c226af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f863a2a3-95a1-47ae-8c85-79acc173726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:38 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Volume volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc (a0a80fb5-d0db-4d41-9f1a-44631a5c08fc): created successfully Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f863a2a3-95a1-47ae-8c85-79acc173726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Flow 'volume_create_manager' (a0ea0bf6-477f-4da0-bb8f-068bbc28fc9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:38 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-2be6516f-554e-45bc-9d6e-0e763e2888b0 tempest-VolumesSnapshotListTestJSON-402692251 None] Created volume successfully. Jul 03 01:14:38 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-689649ab-dc59-45f1-a02d-64cc2da44eb7 tempest-VolumesActionsTest-779841732 None] Terminate volume connection completed successfully. Jul 03 01:14:39 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f" returned: 0 in 0.825s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:14:39 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97cbded-35b3-4fca-8fc1-b2c340cb971f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:39 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 Jul 03 01:14:39 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-689649ab-dc59-45f1-a02d-64cc2da44eb7 tempest-VolumesActionsTest-779841732 None] Acquiring lock "cinder-75e8c802-b0da-4df9-8a7f-759cae941208-detach_volume" by "detach_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-689649ab-dc59-45f1-a02d-64cc2da44eb7 tempest-VolumesActionsTest-779841732 None] Lock "cinder-75e8c802-b0da-4df9-8a7f-759cae941208-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:39 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-689649ab-dc59-45f1-a02d-64cc2da44eb7 tempest-VolumesActionsTest-779841732 None] Detaching volume 75e8c802-b0da-4df9-8a7f-759cae941208 from instance 64a462a5-f770-449a-bc1a-20d445777575. Jul 03 01:14:39 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-689649ab-dc59-45f1-a02d-64cc2da44eb7 tempest-VolumesActionsTest-779841732 None] Detach volume completed successfully. Jul 03 01:14:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-689649ab-dc59-45f1-a02d-64cc2da44eb7 tempest-VolumesActionsTest-779841732 None] Lock "cinder-75e8c802-b0da-4df9-8a7f-759cae941208-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:39 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468 1073741824" returned: 0 in 0.935s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:39 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468 Jul 03 01:14:39 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:39 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=75,cinder:DELETE=10,cinder:UPDATE=89,cinder:INSERT=22 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:14:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:39 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40" returned: 0 in 0.870s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3af4e87d-8455-4e37-884e-b5e5a88ef5ab tempest-VolumesActionsTest-1559067197 None] Acquiring lock "cinder-75e8c802-b0da-4df9-8a7f-759cae941208-detach_volume" by "detach_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:40 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f Jul 03 01:14:40 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3af4e87d-8455-4e37-884e-b5e5a88ef5ab tempest-VolumesActionsTest-1559067197 None] Lock "cinder-75e8c802-b0da-4df9-8a7f-759cae941208-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:40 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3af4e87d-8455-4e37-884e-b5e5a88ef5ab tempest-VolumesActionsTest-1559067197 None] Volume detach called, but volume not attached. Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3af4e87d-8455-4e37-884e-b5e5a88ef5ab tempest-VolumesActionsTest-1559067197 None] Lock "cinder-75e8c802-b0da-4df9-8a7f-759cae941208-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:40 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468" returned: 0 in 0.747s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.356s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] Creating offline snapshot 93bc016a-0e5d-41b3-9ce8-358b4aa10ced of volume a0a80fb5-d0db-4d41-9f1a-44631a5c08fc {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9369b743-c514-4862-bb07-360606363c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe8bda29-e01e-488e-8aaf-614029ec6468', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1dcc0d-a787-44b2-9fd8-e6c7f7ef16cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c790123-c568-4fe1-b054-f91c57db19de]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:40 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Volume volume-fe8bda29-e01e-488e-8aaf-614029ec6468 (fe8bda29-e01e-488e-8aaf-614029ec6468): created successfully Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1dcc0d-a787-44b2-9fd8-e6c7f7ef16cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Flow 'volume_create_manager' (80f9184f-3af8-45e7-ae8a-5a7c3ea26933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:40 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-5a56fe32-50f5-4620-96bd-f6ec1a5fce02 tempest-AttachVolumeNegativeTest-509862070 None] Created volume successfully. Jul 03 01:14:40 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc Jul 03 01:14:40 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Acquiring lock "cinder-75e8c802-b0da-4df9-8a7f-759cae941208-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Lock "cinder-75e8c802-b0da-4df9-8a7f-759cae941208-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Acquiring lock "cinder-quobyte-75e8c802-b0da-4df9-8a7f-759cae941208" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Lock "cinder-quobyte-75e8c802-b0da-4df9-8a7f-759cae941208" acquired by "delete_volume" :: waited 0.035s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:40 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f" returned: 0 in 0.918s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b943f2-6008-4094-a8ad-e9b8f5a61143]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-75e8c802-b0da-4df9-8a7f-759cae941208 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:40 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f Jul 03 01:14:40 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:41 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-75e8c802-b0da-4df9-8a7f-759cae941208 Jul 03 01:14:41 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:41 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" returned: 0 in 1.053s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:41 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced 1G Jul 03 01:14:41 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:42 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40.4680846c-96fe-4c64-80c4-95b1a67ae35f" returned: 0 in 1.101s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-4680846c-96fe-4c64-80c4-95b1a67ae35f" released by "_delete_snapshot" :: held 3.846s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-1dd48aec-7998-4b6f-8564-ca205bf3ba40" released by "delete_snapshot" :: held 3.882s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Created reservations ['fac92c00-9918-4464-9c57-459073529bfa', '21619e1c-568d-4d69-8c39-c8bc9ddff067', 'fc56ad1c-c624-4c5f-913c-b84ebcefd32d', 'f4f6aaed-ce15-4498-b999-6934ee2bab81'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:42 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Delete snapshot completed successfully. Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad91165-fd12-4cd0-b759-89283c296db9 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-4680846c-96fe-4c64-80c4-95b1a67ae35f-delete_snapshot" released by "delete_snapshot" :: held 4.083s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:42 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced 1G" returned: 0 in 0.985s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:42 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced Jul 03 01:14:42 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:42 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-75e8c802-b0da-4df9-8a7f-759cae941208" returned: 0 in 1.439s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-75e8c802-b0da-4df9-8a7f-759cae941208 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:42 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-75e8c802-b0da-4df9-8a7f-759cae941208 Jul 03 01:14:42 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-1dd48aec-7998-4b6f-8564-ca205bf3ba40-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-1dd48aec-7998-4b6f-8564-ca205bf3ba40-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-1dd48aec-7998-4b6f-8564-ca205bf3ba40" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-1dd48aec-7998-4b6f-8564-ca205bf3ba40" acquired by "delete_volume" :: waited 0.047s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8040d2-c6ef-4519-896b-c0ca2ca8b75d]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:42 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 Jul 03 01:14:42 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:43 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-75e8c802-b0da-4df9-8a7f-759cae941208" returned: 0 in 0.842s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Lock "cinder-quobyte-75e8c802-b0da-4df9-8a7f-759cae941208" released by "delete_volume" :: held 2.355s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:43 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Created reservations ['b5f52428-59bd-4429-b51a-2599c949e39f', '127388ec-cbca-4726-9a6d-14886730e976', 'f0c36a84-6660-4921-9f3f-4bb34377e052', '06b088db-fc8a-43e7-a9d2-d705a223f594'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:43 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced" returned: 0 in 0.967s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:43 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced is being set with open permissions: ugo+rw Jul 03 01:14:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:43 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced Jul 03 01:14:43 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:43 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:14:43 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:43 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40" returned: 0 in 0.881s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:43 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40 Jul 03 01:14:43 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:44 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced" returned: 0 in 0.827s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:44 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.769s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:14:44 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Deleted volume successfully. Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-95af53c2-3c75-4fcb-86d5-b8ea50347baa tempest-VolumesActionsTest-1559067197 None] Lock "cinder-75e8c802-b0da-4df9-8a7f-759cae941208-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:44 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.info Jul 03 01:14:44 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:44 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1dd48aec-7998-4b6f-8564-ca205bf3ba40" returned: 0 in 0.783s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-1dd48aec-7998-4b6f-8564-ca205bf3ba40" released by "delete_volume" :: held 1.798s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Created reservations ['4c071703-8c92-40b5-9fc8-b8ed01db686b', 'b07d9e5b-266c-4b33-a7f8-0d2635c9a7da', '54660c42-d626-4cea-b994-7a150e897ccd', 'd01acb99-cfaf-4907-84ef-f793e59dc171'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:44 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:14:44 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-97f21460-9d5c-4c78-9cd6-742f243e59b7 req-abfd098a-d0ce-4fd4-80d7-9ed8ee6dd1a2 tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-652d3d2d-d8a1-41d2-aff4-f0b59298d356-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:44 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.info" returned: 0 in 0.745s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:44 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.info is being set with open permissions: ugo+rw Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-652d3d2d-d8a1-41d2-aff4-f0b59298d356-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:44 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.info Jul 03 01:14:44 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "cinder-quobyte-652d3d2d-d8a1-41d2-aff4-f0b59298d356" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-652d3d2d-d8a1-41d2-aff4-f0b59298d356" acquired by "delete_volume" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:45 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60fe9ad-aa7a-4503-836d-0aeac5277679]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:45 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 Jul 03 01:14:45 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:45 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.028s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:45 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:14:45 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Deleted volume successfully. Jul 03 01:14:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e7b942d4-3f69-4fe8-b3d6-aaccccf0c572 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-1dd48aec-7998-4b6f-8564-ca205bf3ba40-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:45 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.info" returned: 0 in 0.963s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.689s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-97f21460-9d5c-4c78-9cd6-742f243e59b7 req-abfd098a-d0ce-4fd4-80d7-9ed8ee6dd1a2 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.127s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:45 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfdafb9-f50f-45a3-9122-edfe1bb81d08]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-97f21460-9d5c-4c78-9cd6-742f243e59b7 req-abfd098a-d0ce-4fd4-80d7-9ed8ee6dd1a2 tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:46 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-2d01c84c-2840-4171-9c4c-06b71eb80966 tempest-VolumesSnapshotListTestJSON-402692251 None] Create snapshot completed successfully Jul 03 01:14:46 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468 Jul 03 01:14:46 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:46 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356" returned: 0 in 1.188s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:46 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356 Jul 03 01:14:46 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:46 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-97f21460-9d5c-4c78-9cd6-742f243e59b7 req-abfd098a-d0ce-4fd4-80d7-9ed8ee6dd1a2 tempest-AttachVolumeNegativeTest-509862070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468" returned: 0 in 0.944s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-97f21460-9d5c-4c78-9cd6-742f243e59b7 req-abfd098a-d0ce-4fd4-80d7-9ed8ee6dd1a2 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.988s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.460s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] Creating offline snapshot 0421a84d-6161-4478-a9d7-faba06cff99e of volume a0a80fb5-d0db-4d41-9f1a-44631a5c08fc {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:14:46 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-652d3d2d-d8a1-41d2-aff4-f0b59298d356" returned: 0 in 0.750s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f880901-5cf4-45b3-8deb-10e7d92996ff]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-quobyte-652d3d2d-d8a1-41d2-aff4-f0b59298d356" released by "delete_volume" :: held 2.024s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-97f21460-9d5c-4c78-9cd6-742f243e59b7 req-abfd098a-d0ce-4fd4-80d7-9ed8ee6dd1a2 tempest-AttachVolumeNegativeTest-509862070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-fe8bda29-e01e-488e-8aaf-614029ec6468', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c1d21b9-ea56-4e31-a93a-46ec7cf74fa2', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:14:47 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced Jul 03 01:14:47 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Created reservations ['28aa3d73-e5a8-43e6-91d9-46fc4de87653', 'fa480824-13d3-42fa-b6b6-b33d840f6a4d', '9a409b04-487f-45c4-b681-95c5a322d5e7', 'f87bdf5f-4de9-4a53-b3bc-9e9d2cf93010'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:47 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-97f21460-9d5c-4c78-9cd6-742f243e59b7 req-abfd098a-d0ce-4fd4-80d7-9ed8ee6dd1a2 tempest-AttachVolumeNegativeTest-509862070 None] attachment_update completed successfully. Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:47 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:14:47 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:47 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced" returned: 0 in 0.954s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:14:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:48 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e 1G Jul 03 01:14:48 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:48 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.722s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:48 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:14:48 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Deleted volume successfully. Jul 03 01:14:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eea8fc38-e9e0-406d-b822-73d11199ac54 tempest-VolumesSnapshotTestJSON-1076177584 None] Lock "cinder-652d3d2d-d8a1-41d2-aff4-f0b59298d356-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:48 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e 1G" returned: 0 in 0.913s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:48 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e Jul 03 01:14:48 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:49 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e" returned: 0 in 0.758s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:49 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e is being set with open permissions: ugo+rw Jul 03 01:14:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:49 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e Jul 03 01:14:49 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:50 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e" returned: 0 in 0.691s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.449s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:50 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-cb336cd0-1a9a-4a77-9c69-0a6bd01bb261 tempest-VolumesSnapshotListTestJSON-402692251 None] Create snapshot completed successfully Jul 03 01:14:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] Creating offline snapshot 302fbfda-8210-4d21-bce9-10fc6d50d9b9 of volume a0a80fb5-d0db-4d41-9f1a-44631a5c08fc {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:14:51 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd639c52-4f89-4293-bd39-542debbeaa06]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:51 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e Jul 03 01:14:51 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:51 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e" returned: 0 in 0.814s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:14:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:51 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 1G Jul 03 01:14:51 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:52 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:14:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Flow 'volume_create_manager' (ea63b08c-2f1d-4d1a-9305-c939ed7242a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85d19d0-4882-4a03-8277-b8e35b8672e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85d19d0-4882-4a03-8277-b8e35b8672e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519506041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87972ee2-edac-431a-b66f-514becf9a601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbd3f898a634ebcaad2dc0cd251d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:53Z,use_quota=True,user_id='2806b68b55b64323b29b70fb50a385fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c552f613-e760-4262-87a7-4a840b69c331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c552f613-e760-4262-87a7-4a840b69c331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453f9809-74de-4338-90d7-ea46311f71ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453f9809-74de-4338-90d7-ea46311f71ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87972ee2-edac-431a-b66f-514becf9a601', 'volume_name': 'volume-87972ee2-edac-431a-b66f-514becf9a601', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa178694-16e9-4088-929e-3aa2a462e9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa178694-16e9-4088-929e-3aa2a462e9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8401cb47-b2b1-45d4-919f-31e5e4926fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:52 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Volume 87972ee2-edac-431a-b66f-514becf9a601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87972ee2-edac-431a-b66f-514becf9a601', 'volume_size': 1} Jul 03 01:14:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:53 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 1G" returned: 0 in 1.462s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:53 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 Jul 03 01:14:53 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:54 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9" returned: 0 in 0.904s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:54 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 is being set with open permissions: ugo+rw Jul 03 01:14:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:54 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 Jul 03 01:14:54 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:55 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9" returned: 0 in 0.789s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.084s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.191s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519506041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87972ee2-edac-431a-b66f-514becf9a601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbd3f898a634ebcaad2dc0cd251d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:53Z,use_quota=True,user_id='2806b68b55b64323b29b70fb50a385fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:14:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Creating volume 87972ee2-edac-431a-b66f-514becf9a601 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:14:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:14:55 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:14:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-87972ee2-edac-431a-b66f-514becf9a601 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:55 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-87972ee2-edac-431a-b66f-514becf9a601 1073741824 Jul 03 01:14:55 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:55 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7cca9cab-1865-4972-8776-77870c0f1e14 tempest-VolumesSnapshotListTestJSON-402692251 None] Create snapshot completed successfully Jul 03 01:14:56 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-87972ee2-edac-431a-b66f-514becf9a601 1073741824" returned: 0 in 1.018s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-87972ee2-edac-431a-b66f-514becf9a601 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:56 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-87972ee2-edac-431a-b66f-514becf9a601 Jul 03 01:14:56 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:57 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-87972ee2-edac-431a-b66f-514becf9a601" returned: 0 in 0.903s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8401cb47-b2b1-45d4-919f-31e5e4926fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87972ee2-edac-431a-b66f-514becf9a601', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51b24b8-3251-46d5-857e-24e45decb645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:57 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Volume volume-87972ee2-edac-431a-b66f-514becf9a601 (87972ee2-edac-431a-b66f-514becf9a601): created successfully Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51b24b8-3251-46d5-857e-24e45decb645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Flow 'volume_create_manager' (ea63b08c-2f1d-4d1a-9305-c939ed7242a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:57 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c02d7730-d680-449e-91e0-0afd2ab3a224 tempest-VolumesActionsTest-1559067197 None] Created volume successfully. Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "cinder-302fbfda-8210-4d21-bce9-10fc6d50d9b9-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-302fbfda-8210-4d21-bce9-10fc6d50d9b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "cinder-quobyte-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "cinder-quobyte-302fbfda-8210-4d21-bce9-10fc6d50d9b9" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-302fbfda-8210-4d21-bce9-10fc6d50d9b9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Deleting offline snapshot 302fbfda-8210-4d21-bce9-10fc6d50d9b9 of volume a0a80fb5-d0db-4d41-9f1a-44631a5c08fc {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] snapshot_file for this snap is: volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe009bd-b347-4644-8a2d-2ade958cbbbf]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:57 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 Jul 03 01:14:57 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Acquiring lock "cinder-87972ee2-edac-431a-b66f-514becf9a601-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Lock "cinder-87972ee2-edac-431a-b66f-514becf9a601-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Acquiring lock "cinder-quobyte-87972ee2-edac-431a-b66f-514becf9a601" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Lock "cinder-quobyte-87972ee2-edac-431a-b66f-514becf9a601" acquired by "delete_volume" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:58 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[47413648-8267-4ce8-b4c8-43a699967cf1]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-87972ee2-edac-431a-b66f-514becf9a601 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:58 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-87972ee2-edac-431a-b66f-514becf9a601 Jul 03 01:14:58 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:58 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9" returned: 0 in 0.921s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:14:58 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9447a6-456e-4b8f-96c3-41b4558edab0]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:58 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e Jul 03 01:14:58 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:59 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-87972ee2-edac-431a-b66f-514becf9a601" returned: 0 in 0.889s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-87972ee2-edac-431a-b66f-514becf9a601 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:59 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-87972ee2-edac-431a-b66f-514becf9a601 Jul 03 01:14:59 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:59 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e" returned: 0 in 0.978s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:59 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:14:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:59 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 Jul 03 01:14:59 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:00 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-87972ee2-edac-431a-b66f-514becf9a601" returned: 0 in 0.721s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Lock "cinder-quobyte-87972ee2-edac-431a-b66f-514becf9a601" released by "delete_volume" :: held 1.689s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:00 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Created reservations ['7e0ea217-68d1-40e5-8d5d-e847c5c4cf86', '6efce82a-a2f2-45ef-a796-30bc4f42ef68', 'd0a1308d-a010-42a4-a01f-03ce03cc6e98', '318f1aa9-90ff-4ba0-b432-55f7b23efb64'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:00 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:15:00 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:00 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9" returned: 0 in 1.062s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:00 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9 Jul 03 01:15:00 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:01 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.886s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:01 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Deleted volume successfully. Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-353b5b66-0552-48aa-9042-9a3058edaaea tempest-VolumesActionsTest-779841732 None] Lock "cinder-87972ee2-edac-431a-b66f-514becf9a601-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Flow 'volume_create_manager' (83c98708-6ab6-4d93-85f9-d9c26e67ea23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8b0d58-3614-45a4-ac03-c8e83ceb7357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8b0d58-3614-45a4-ac03-c8e83ceb7357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1647365491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e81b833-c0a8-4f80-8e33-ed0df71fe035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbd3f898a634ebcaad2dc0cd251d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:01Z,use_quota=True,user_id='2806b68b55b64323b29b70fb50a385fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c40d068-ede7-4ea7-8c51-f82eab65e560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c40d068-ede7-4ea7-8c51-f82eab65e560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2d2cbe-c1f3-42e0-8659-5798474a04ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2d2cbe-c1f3-42e0-8659-5798474a04ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e81b833-c0a8-4f80-8e33-ed0df71fe035', 'volume_name': 'volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d058eb-61af-4f81-b695-387824cc0506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d058eb-61af-4f81-b695-387824cc0506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bc15d3-bc2e-4690-a42f-876fdf84875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:01 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Volume 2e81b833-c0a8-4f80-8e33-ed0df71fe035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035', 'volume_size': 1} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1647365491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e81b833-c0a8-4f80-8e33-ed0df71fe035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbd3f898a634ebcaad2dc0cd251d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:01Z,use_quota=True,user_id='2806b68b55b64323b29b70fb50a385fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Creating volume 2e81b833-c0a8-4f80-8e33-ed0df71fe035 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:15:01 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:01 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035 1073741824 Jul 03 01:15:01 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:01 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.302fbfda-8210-4d21-bce9-10fc6d50d9b9" returned: 0 in 0.972s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-302fbfda-8210-4d21-bce9-10fc6d50d9b9" released by "_delete_snapshot" :: held 4.104s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" released by "delete_snapshot" :: held 4.142s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:01 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Created reservations ['954c8022-dba0-4a79-98f3-f0f397a95a86', 'cbb724ba-7d57-4593-909e-081e98f234f9', 'ebae483e-9d64-41a3-b428-8c82af973e41', 'd1f3a27d-50da-449e-b8d2-d9e179216000'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:02 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Delete snapshot completed successfully. Jul 03 01:15:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-166c0206-5cd4-432b-a251-50e0497b7520 tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-302fbfda-8210-4d21-bce9-10fc6d50d9b9-delete_snapshot" released by "delete_snapshot" :: held 4.492s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "cinder-0421a84d-6161-4478-a9d7-faba06cff99e-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-0421a84d-6161-4478-a9d7-faba06cff99e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "cinder-quobyte-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "cinder-quobyte-0421a84d-6161-4478-a9d7-faba06cff99e" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-0421a84d-6161-4478-a9d7-faba06cff99e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:03 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Deleting offline snapshot 0421a84d-6161-4478-a9d7-faba06cff99e of volume a0a80fb5-d0db-4d41-9f1a-44631a5c08fc {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:15:03 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] snapshot_file for this snap is: volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:15:03 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035 1073741824" returned: 0 in 1.635s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:03 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00dc87f-48ba-4faf-9385-ff37d67c0f94]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:03 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035 Jul 03 01:15:03 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:03 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e Jul 03 01:15:03 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:04 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035" returned: 0 in 0.942s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] <== create_volume: return (2669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.672s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bc15d3-bc2e-4690-a42f-876fdf84875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26f5039-ae06-423a-9436-81ceb39c0a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:04 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Volume volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035 (2e81b833-c0a8-4f80-8e33-ed0df71fe035): created successfully Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26f5039-ae06-423a-9436-81ceb39c0a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Flow 'volume_create_manager' (83c98708-6ab6-4d93-85f9-d9c26e67ea23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:04 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ea5444d2-da07-4924-acd4-7e9b037fe773 tempest-VolumesActionsTest-1559067197 None] Created volume successfully. Jul 03 01:15:04 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e" returned: 0 in 1.333s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aca542b-4ed6-462f-a5ef-9f100c9f195a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:04 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced Jul 03 01:15:04 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Acquiring lock "cinder-2e81b833-c0a8-4f80-8e33-ed0df71fe035-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Lock "cinder-2e81b833-c0a8-4f80-8e33-ed0df71fe035-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Acquiring lock "cinder-quobyte-2e81b833-c0a8-4f80-8e33-ed0df71fe035" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Lock "cinder-quobyte-2e81b833-c0a8-4f80-8e33-ed0df71fe035" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[383fc7c4-cc6f-48d4-b104-eeb938fbec14]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:05 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035 Jul 03 01:15:05 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:05 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced" returned: 0 in 1.050s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:15:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:05 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e Jul 03 01:15:05 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:06 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035" returned: 0 in 1.105s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:06 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035 Jul 03 01:15:06 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:06 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e" returned: 0 in 1.117s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:06 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e Jul 03 01:15:06 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:07 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2e81b833-c0a8-4f80-8e33-ed0df71fe035" returned: 0 in 0.924s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Lock "cinder-quobyte-2e81b833-c0a8-4f80-8e33-ed0df71fe035" released by "delete_volume" :: held 2.099s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Created reservations ['bc156bd8-3fc4-404f-96c0-9f6bef6bb087', 'd80f3d20-fad0-4b88-9611-003d76cc8085', '49b73e32-7b53-4c4a-ab91-1fb57e1b9d3d', 'b6ee8df6-ab19-47ce-8c1d-20f0da56c942'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:07 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:15:07 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:07 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.0421a84d-6161-4478-a9d7-faba06cff99e" returned: 0 in 0.747s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-0421a84d-6161-4478-a9d7-faba06cff99e" released by "_delete_snapshot" :: held 4.405s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" released by "delete_snapshot" :: held 4.437s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Created reservations ['2de48cbe-ac16-450f-a1df-6aaf8a476faf', 'f70a6da5-55db-4865-9c49-598f0e903ebc', '1d109fa3-f2cb-4ccd-bd06-3dc0c9a8f14d', 'c6aad87d-196f-4967-ae19-a19591b2d049'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:07 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Delete snapshot completed successfully. Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b06c819d-30e3-4807-ac62-6d40185f938b tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-0421a84d-6161-4478-a9d7-faba06cff99e-delete_snapshot" released by "delete_snapshot" :: held 4.667s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:07 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.717s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:07 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:07 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Deleted volume successfully. Jul 03 01:15:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a866fe3b-18b4-41ee-8aac-b746b13adc3f tempest-VolumesActionsTest-779841732 None] Lock "cinder-2e81b833-c0a8-4f80-8e33-ed0df71fe035-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "cinder-93bc016a-0e5d-41b3-9ce8-358b4aa10ced-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-93bc016a-0e5d-41b3-9ce8-358b4aa10ced-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "cinder-quobyte-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "cinder-quobyte-93bc016a-0e5d-41b3-9ce8-358b4aa10ced" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-93bc016a-0e5d-41b3-9ce8-358b4aa10ced" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Deleting offline snapshot 93bc016a-0e5d-41b3-9ce8-358b4aa10ced of volume a0a80fb5-d0db-4d41-9f1a-44631a5c08fc {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:15:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] snapshot_file for this snap is: volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:15:08 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcb6fb2-f0a2-45c5-ae10-c7a9c8ab98e5]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:08 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced Jul 03 01:15:08 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:08 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Flow 'volume_create_manager' (2b050376-9cca-4fd0-9bcf-b5977e91d25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbb5f23-d594-4c3e-9e62-2262103a3b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbb5f23-d594-4c3e-9e62-2262103a3b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-657865277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a86eb6-b732-47b5-8653-bf00e3cc550c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbd3f898a634ebcaad2dc0cd251d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:09Z,use_quota=True,user_id='2806b68b55b64323b29b70fb50a385fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b32eff-5c34-4dd5-aec9-82cd0b2b06b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b32eff-5c34-4dd5-aec9-82cd0b2b06b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133ba0fd-88bf-4b39-8cce-c4e1a9ec9c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133ba0fd-88bf-4b39-8cce-c4e1a9ec9c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9a86eb6-b732-47b5-8653-bf00e3cc550c', 'volume_name': 'volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386bae47-cf4e-4b64-af18-f4f8f4fefca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386bae47-cf4e-4b64-af18-f4f8f4fefca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cab8021-e908-4b59-bdf5-6fc92490cf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:09 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Volume d9a86eb6-b732-47b5-8653-bf00e3cc550c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c', 'volume_size': 1} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-657865277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a86eb6-b732-47b5-8653-bf00e3cc550c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbd3f898a634ebcaad2dc0cd251d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:09Z,use_quota=True,user_id='2806b68b55b64323b29b70fb50a385fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Creating volume d9a86eb6-b732-47b5-8653-bf00e3cc550c {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:15:09 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:09 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c 1073741824 Jul 03 01:15:09 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:09 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced" returned: 0 in 0.955s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13e3cf4-b4a3-4f89-940d-b40342e2b622]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:10 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc Jul 03 01:15:10 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:10 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c 1073741824" returned: 0 in 1.660s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:10 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c Jul 03 01:15:10 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:11 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" returned: 0 in 1.750s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:11 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced Jul 03 01:15:11 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:12 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c" returned: 0 in 1.246s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] <== create_volume: return (3002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:15:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cab8021-e908-4b59-bdf5-6fc92490cf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4478bb10-db9e-4e04-8206-1b689cb96aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:12 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Volume volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c (d9a86eb6-b732-47b5-8653-bf00e3cc550c): created successfully Jul 03 01:15:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4478bb10-db9e-4e04-8206-1b689cb96aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Flow 'volume_create_manager' (2b050376-9cca-4fd0-9bcf-b5977e91d25a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:12 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-981c4e8f-1015-4cb6-89f0-6eeb502db4b0 tempest-VolumesActionsTest-1559067197 None] Created volume successfully. Jul 03 01:15:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Acquiring lock "cinder-d9a86eb6-b732-47b5-8653-bf00e3cc550c-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Lock "cinder-d9a86eb6-b732-47b5-8653-bf00e3cc550c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:12 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced" returned: 0 in 1.534s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Acquiring lock "cinder-quobyte-d9a86eb6-b732-47b5-8653-bf00e3cc550c" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:12 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced Jul 03 01:15:12 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Lock "cinder-quobyte-d9a86eb6-b732-47b5-8653-bf00e3cc550c" acquired by "delete_volume" :: waited 0.036s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:13 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed86706-5381-4ab9-9dad-92fd7807cb59]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:13 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c Jul 03 01:15:13 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:13 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc.93bc016a-0e5d-41b3-9ce8-358b4aa10ced" returned: 0 in 1.010s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-93bc016a-0e5d-41b3-9ce8-358b4aa10ced" released by "_delete_snapshot" :: held 5.505s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" released by "delete_snapshot" :: held 5.553s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:14 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Created reservations ['280b0032-6f7c-4d8e-844c-7724b50195d2', '7c30b289-770b-4419-b8d0-5e6c5ec45a1b', '2f215cbc-1781-4caf-9a6b-bdd5bb602735', '1cc49afc-8702-411d-965c-ec98ad3b6e2c'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:14 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Delete snapshot completed successfully. Jul 03 01:15:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-de498824-2200-440e-aad5-8c3a360ca9cb tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-93bc016a-0e5d-41b3-9ce8-358b4aa10ced-delete_snapshot" released by "delete_snapshot" :: held 5.825s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:14 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c" returned: 0 in 1.411s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:14 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c Jul 03 01:15:14 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "cinder-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=101,cinder:INSERT=29,cinder:UPDATE=116,cinder:DELETE=8 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "cinder-quobyte-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" acquired by "delete_volume" :: waited 0.041s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d0891e-21ac-4a2d-a0c7-926881f886d4]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:15 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc Jul 03 01:15:15 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:15 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9a86eb6-b732-47b5-8653-bf00e3cc550c" returned: 0 in 1.110s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Lock "cinder-quobyte-d9a86eb6-b732-47b5-8653-bf00e3cc550c" released by "delete_volume" :: held 2.601s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Created reservations ['ea15ee26-a029-4cdc-a152-1d82cd0c4988', 'c1585066-a38c-4fa9-9586-7a57351a1671', 'e73c5c65-76dc-4259-83a9-475cbacaa45a', '50e43309-32b4-42fa-bba1-f512dbde9ea4'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:15 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:15:15 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:16 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" returned: 0 in 1.551s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:16 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc Jul 03 01:15:16 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:16 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.156s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:16 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Deleted volume successfully. Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-79c26c1a-007c-4b36-a033-126e0613adce tempest-VolumesActionsTest-779841732 None] Lock "cinder-d9a86eb6-b732-47b5-8653-bf00e3cc550c-delete_volume" released by "delete_volume" :: held 4.192s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Flow 'volume_create_manager' (2ca3fd53-058d-44c5-b850-fc7ee49a2cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02adf47-836e-4420-a581-f390d4ab4a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02adf47-836e-4420-a581-f390d4ab4a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-831487361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236a7ff3-eb08-4be1-9d6d-0353163326e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbd3f898a634ebcaad2dc0cd251d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:17Z,use_quota=True,user_id='2806b68b55b64323b29b70fb50a385fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8aa6e9-289c-4c48-936f-522e757fdd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8aa6e9-289c-4c48-936f-522e757fdd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e98b063-22b1-4ba8-8410-4db2d98629e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e98b063-22b1-4ba8-8410-4db2d98629e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '236a7ff3-eb08-4be1-9d6d-0353163326e9', 'volume_name': 'volume-236a7ff3-eb08-4be1-9d6d-0353163326e9', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f89ab0a-b776-4c28-aa95-292da6d059c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f89ab0a-b776-4c28-aa95-292da6d059c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc5b9ab-a0b2-42e2-97a7-7552f46a6384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:17 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Volume 236a7ff3-eb08-4be1-9d6d-0353163326e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-236a7ff3-eb08-4be1-9d6d-0353163326e9', 'volume_size': 1} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-831487361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236a7ff3-eb08-4be1-9d6d-0353163326e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbd3f898a634ebcaad2dc0cd251d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:17Z,use_quota=True,user_id='2806b68b55b64323b29b70fb50a385fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Creating volume 236a7ff3-eb08-4be1-9d6d-0353163326e9 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:15:17 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:15:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-236a7ff3-eb08-4be1-9d6d-0353163326e9 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:17 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-236a7ff3-eb08-4be1-9d6d-0353163326e9 1073741824 Jul 03 01:15:17 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:18 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" returned: 0 in 1.294s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-quobyte-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc" released by "delete_volume" :: held 2.947s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:18 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Created reservations ['be563e79-15ab-491f-bb48-76649a8d8bc6', '6168f3b1-7b8b-4727-98dd-d988853ba286', '5f97cd09-c66b-4d31-86c4-920735a2dfe3', 'cebd0a5b-bc90-483c-bb84-4f4982e264ac'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:18 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:15:18 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:19 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-236a7ff3-eb08-4be1-9d6d-0353163326e9 1073741824" returned: 0 in 1.497s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-236a7ff3-eb08-4be1-9d6d-0353163326e9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:19 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-236a7ff3-eb08-4be1-9d6d-0353163326e9 Jul 03 01:15:19 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:19 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.964s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:19 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:19 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Deleted volume successfully. Jul 03 01:15:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab3ba756-275e-457a-a18c-c411ff52605c tempest-VolumesSnapshotListTestJSON-402692251 None] Lock "cinder-a0a80fb5-d0db-4d41-9f1a-44631a5c08fc-delete_volume" released by "delete_volume" :: held 4.334s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:20 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-236a7ff3-eb08-4be1-9d6d-0353163326e9" returned: 0 in 0.969s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] <== create_volume: return (2538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:15:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.543s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc5b9ab-a0b2-42e2-97a7-7552f46a6384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-236a7ff3-eb08-4be1-9d6d-0353163326e9', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51f7506-e4f1-45a3-91fa-26e8aca705b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:20 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Volume volume-236a7ff3-eb08-4be1-9d6d-0353163326e9 (236a7ff3-eb08-4be1-9d6d-0353163326e9): created successfully Jul 03 01:15:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51f7506-e4f1-45a3-91fa-26e8aca705b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Flow 'volume_create_manager' (2ca3fd53-058d-44c5-b850-fc7ee49a2cec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:20 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ce11fadb-48c7-4847-83e4-0419bacabdd2 tempest-VolumesActionsTest-1559067197 None] Created volume successfully. Jul 03 01:15:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Acquiring lock "cinder-236a7ff3-eb08-4be1-9d6d-0353163326e9-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Lock "cinder-236a7ff3-eb08-4be1-9d6d-0353163326e9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Acquiring lock "cinder-quobyte-236a7ff3-eb08-4be1-9d6d-0353163326e9" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Lock "cinder-quobyte-236a7ff3-eb08-4be1-9d6d-0353163326e9" acquired by "delete_volume" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:21 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea5f245-2108-4cc4-a6db-31d3a3aee5bb]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-236a7ff3-eb08-4be1-9d6d-0353163326e9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:21 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-236a7ff3-eb08-4be1-9d6d-0353163326e9 Jul 03 01:15:21 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:22 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-236a7ff3-eb08-4be1-9d6d-0353163326e9" returned: 0 in 1.449s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-236a7ff3-eb08-4be1-9d6d-0353163326e9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:22 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-236a7ff3-eb08-4be1-9d6d-0353163326e9 Jul 03 01:15:22 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-236a7ff3-eb08-4be1-9d6d-0353163326e9" returned: 0 in 1.127s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:23 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Lock "cinder-quobyte-236a7ff3-eb08-4be1-9d6d-0353163326e9" released by "delete_volume" :: held 2.658s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:23 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Created reservations ['08dfb064-db46-449a-b468-8b6901f5f8d1', 'df14176e-9425-4bce-8769-d55a49a3079e', '22dab78d-4725-44da-874a-94bfa2b47804', '6a2e4e95-8fea-4b29-8be8-4f238ed0955a'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:24 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:15:24 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Flow 'volume_create_manager' (87cb31a9-5588-4c37-afe3-dcf015a9ce97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2891db-75a3-48e8-800b-e2eb6b654a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2891db-75a3-48e8-800b-e2eb6b654a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2034412330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1d7d41-a1d5-44da-bca3-691bf9f4e70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c8d698329141258a10e1770e50ad2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:24Z,use_quota=True,user_id='d872a85048b04054a4f672683cc1d70f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b57f83-3764-41d8-a3cf-88b13355b612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b57f83-3764-41d8-a3cf-88b13355b612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046d2afc-594d-4869-b225-b7642632514a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046d2afc-594d-4869-b225-b7642632514a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d1d7d41-a1d5-44da-bca3-691bf9f4e70a', 'volume_name': 'volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a', 'volume_size': 2}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcafc527-f826-4e43-9100-bc11cfbd7eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcafc527-f826-4e43-9100-bc11cfbd7eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0e8cc3-5361-4cab-828f-c5f4540322ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:24 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Volume 9d1d7d41-a1d5-44da-bca3-691bf9f4e70a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a', 'volume_size': 2} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2034412330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1d7d41-a1d5-44da-bca3-691bf9f4e70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c8d698329141258a10e1770e50ad2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:24Z,use_quota=True,user_id='d872a85048b04054a4f672683cc1d70f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Creating volume 9d1d7d41-a1d5-44da-bca3-691bf9f4e70a {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:15:24 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a 2147483648 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:24 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a 2147483648 Jul 03 01:15:24 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:24 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.807s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:24 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Deleted volume successfully. Jul 03 01:15:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1580d790-6892-450b-b7ee-a353e442aa98 tempest-VolumesActionsTest-779841732 None] Lock "cinder-236a7ff3-eb08-4be1-9d6d-0353163326e9-delete_volume" released by "delete_volume" :: held 3.867s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Flow 'volume_create_manager' (07b390ca-2a5e-4b49-a1f5-eb7017c5aac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b6a2de-5e4c-47eb-a829-99965d314c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b6a2de-5e4c-47eb-a829-99965d314c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-575106877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4d2149-c4ef-4ea9-94ee-ea405ba4c234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbd3f898a634ebcaad2dc0cd251d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:25Z,use_quota=True,user_id='2806b68b55b64323b29b70fb50a385fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c64f130-0aff-4955-a809-88fd91c3031c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c64f130-0aff-4955-a809-88fd91c3031c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca5d50d-8ec6-4f96-80f1-c90029402a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca5d50d-8ec6-4f96-80f1-c90029402a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c4d2149-c4ef-4ea9-94ee-ea405ba4c234', 'volume_name': 'volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3f976b-9757-480a-9fad-227cef478698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3f976b-9757-480a-9fad-227cef478698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65c599b-cbfd-4e17-9ebc-23f17fcb54e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:25 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Volume 5c4d2149-c4ef-4ea9-94ee-ea405ba4c234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234', 'volume_size': 1} Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:25 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a 2147483648" returned: 0 in 1.089s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:25 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a Jul 03 01:15:25 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:26 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a" returned: 0 in 0.796s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.310s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-575106877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4d2149-c4ef-4ea9-94ee-ea405ba4c234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbd3f898a634ebcaad2dc0cd251d2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:25Z,use_quota=True,user_id='2806b68b55b64323b29b70fb50a385fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Creating volume 5c4d2149-c4ef-4ea9-94ee-ea405ba4c234 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:15:26 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:26 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234 1073741824 Jul 03 01:15:26 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0e8cc3-5361-4cab-828f-c5f4540322ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a', 'volume_size': 2}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c949411-fe8b-4586-8ae9-33dd8ae5874e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:26 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Volume volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a (9d1d7d41-a1d5-44da-bca3-691bf9f4e70a): created successfully Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c949411-fe8b-4586-8ae9-33dd8ae5874e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Flow 'volume_create_manager' (87cb31a9-5588-4c37-afe3-dcf015a9ce97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:26 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-dfef7652-2069-4fb0-87a3-cced30c62a1f tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Created volume successfully. Jul 03 01:15:27 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234 1073741824" returned: 0 in 1.043s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:27 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234 Jul 03 01:15:27 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:15:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:27 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:15:27 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:28 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234" returned: 0 in 0.778s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.598s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65c599b-cbfd-4e17-9ebc-23f17fcb54e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cedebb-2913-4919-ace9-046116db0a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Creating offline snapshot 53770395-60e2-4005-9716-a798987b613e of volume 9d1d7d41-a1d5-44da-bca3-691bf9f4e70a {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:15:28 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Volume volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234 (5c4d2149-c4ef-4ea9-94ee-ea405ba4c234): created successfully Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cedebb-2913-4919-ace9-046116db0a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Flow 'volume_create_manager' (07b390ca-2a5e-4b49-a1f5-eb7017c5aac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6091f38-519d-49fe-88c8-d003328a75b6]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:28 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-89dc3383-91ca-4c18-9566-9d92a7bf1fe7 tempest-VolumesActionsTest-1559067197 None] Created volume successfully. Jul 03 01:15:28 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.761s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:15:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:15:28 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a Jul 03 01:15:28 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:29 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a" returned: 0 in 0.883s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e 2G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:29 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e 2G Jul 03 01:15:29 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Acquiring lock "cinder-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Lock "cinder-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Acquiring lock "cinder-quobyte-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Lock "cinder-quobyte-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:30 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc76337-6a53-483f-b444-d99187079dd3]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:30 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234 Jul 03 01:15:30 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:30 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e 2G" returned: 0 in 1.137s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:30 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e Jul 03 01:15:30 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:31 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e" returned: 0 in 0.866s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:31 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e is being set with open permissions: ugo+rw Jul 03 01:15:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:31 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e Jul 03 01:15:31 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:31 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234" returned: 0 in 1.209s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:31 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234 Jul 03 01:15:31 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:32 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e" returned: 0 in 0.731s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:32 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.info Jul 03 01:15:32 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:32 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234" returned: 0 in 1.004s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Lock "cinder-quobyte-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234" released by "delete_volume" :: held 2.266s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:32 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Created reservations ['289e9d35-55ee-4446-818c-e2cd107b70bb', '7ab616ef-0f9e-4c98-9b76-585511a39b77', 'a8f9e7d0-abab-4574-a352-390a3e43094a', '031e1600-952e-413d-8c3d-ad48716ee030'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:32 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:15:32 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:33 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.info" returned: 0 in 0.830s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:33 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.info is being set with open permissions: ugo+rw Jul 03 01:15:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:33 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.info Jul 03 01:15:33 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:33 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.740s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:33 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:33 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Deleted volume successfully. Jul 03 01:15:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5a4a8e9b-6290-46c8-b9e0-9351e050ad0a tempest-VolumesActionsTest-1559067197 None] Lock "cinder-5c4d2149-c4ef-4ea9-94ee-ea405ba4c234-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:33 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.info" returned: 0 in 0.671s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.275s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:33 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9c84de6f-ffe4-407a-87b7-91d731b867d8 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Create snapshot completed successfully Jul 03 01:15:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Acquiring lock "cinder-53770395-60e2-4005-9716-a798987b613e-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "cinder-53770395-60e2-4005-9716-a798987b613e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Acquiring lock "cinder-quobyte-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "cinder-quobyte-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Acquiring lock "cinder-quobyte-53770395-60e2-4005-9716-a798987b613e" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "cinder-quobyte-53770395-60e2-4005-9716-a798987b613e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Deleting offline snapshot 53770395-60e2-4005-9716-a798987b613e of volume 9d1d7d41-a1d5-44da-bca3-691bf9f4e70a {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:15:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] snapshot_file for this snap is: volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:15:34 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[7827b4af-66e5-40de-b435-66b7485c7afc]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:34 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e Jul 03 01:15:34 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:35 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e" returned: 0 in 0.872s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:15:35 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c575640-e6b4-4aae-a19c-3084d42df754]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:35 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a Jul 03 01:15:35 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:36 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a" returned: 0 in 0.912s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:36 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e Jul 03 01:15:36 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:37 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e" returned: 0 in 1.062s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:37 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e Jul 03 01:15:37 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:38 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a.53770395-60e2-4005-9716-a798987b613e" returned: 0 in 1.121s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "cinder-quobyte-53770395-60e2-4005-9716-a798987b613e" released by "_delete_snapshot" :: held 4.171s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "cinder-quobyte-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a" released by "delete_snapshot" :: held 4.201s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:38 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Created reservations ['0e000b2b-0efa-49a5-bc3b-e6f9d6cbbcc8', '1ac0723d-62a0-42c1-aa10-05003a8d4776', '4c945e54-180c-4e94-9009-049ba29b21e3', 'a27acb68-e0dd-444f-9a47-ada9cf458740'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:38 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Delete snapshot completed successfully. Jul 03 01:15:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e99abf9-fae3-471f-b475-2ddfdea16569 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "cinder-53770395-60e2-4005-9716-a798987b613e-delete_snapshot" released by "delete_snapshot" :: held 4.431s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Acquiring lock "cinder-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "cinder-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Acquiring lock "cinder-quobyte-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "cinder-quobyte-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a" acquired by "delete_volume" :: waited 0.037s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:40 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb4247f-0773-470a-a161-a41dc0ad2c5e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:40 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a Jul 03 01:15:40 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:41 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a" returned: 0 in 1.109s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:41 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a Jul 03 01:15:41 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:42 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a" returned: 0 in 1.119s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "cinder-quobyte-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a" released by "delete_volume" :: held 2.362s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:42 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=122,cinder:DELETE=11,cinder:SELECT=102,cinder:INSERT=32 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:15:42 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Created reservations ['eba4db99-6045-4cfa-9e54-62e68252c767', '5a78e557-1d2f-4522-b4eb-64003e409c5d', '9746e919-22c1-4253-a1fa-83a22f13e599', 'd7ce53be-55eb-44ca-9e89-4410a989f140'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:42 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:15:42 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:43 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.751s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:43 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:43 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Deleted volume successfully. Jul 03 01:15:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fc139a0e-193d-4b5d-b69d-e1eeb57f0449 tempest-VolumesSnapshotNegativeTestJSON-284435756 None] Lock "cinder-9d1d7d41-a1d5-44da-bca3-691bf9f4e70a-delete_volume" released by "delete_volume" :: held 3.416s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:48 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-7a244b84-22bd-48ae-876c-bfe472bbb8a3 req-a01127c9-6c18-482d-9db6-4f20eb580ba9 tempest-AttachVolumeNegativeTest-509862070 None] Terminate volume connection completed successfully. Jul 03 01:15:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-7a244b84-22bd-48ae-876c-bfe472bbb8a3 req-a01127c9-6c18-482d-9db6-4f20eb580ba9 tempest-AttachVolumeNegativeTest-509862070 None] Deleting attachment 2c1d21b9-ea56-4e31-a93a-46ec7cf74fa2. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Flow 'volume_create_manager' (bfb686ee-6807-4fd7-bb9e-1ed240fcb974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f14073-4091-4bd5-ac8a-6faf144aece3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f14073-4091-4bd5-ac8a-6faf144aece3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1886124829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a893c13-5480-4758-8b55-d251de756838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e819a3743a8c42dbbf581d3be1448419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:54Z,use_quota=True,user_id='7959f63c1f814ce4a12e56c40708b754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b01fe4-dbcf-40ec-9d97-09a20a5a1929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b01fe4-dbcf-40ec-9d97-09a20a5a1929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d86bb6-4bb9-4fe2-930f-b7acc928cb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d86bb6-4bb9-4fe2-930f-b7acc928cb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a893c13-5480-4758-8b55-d251de756838', 'volume_name': 'volume-4a893c13-5480-4758-8b55-d251de756838', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c012d7-c90b-4f9c-9f00-1657367350c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c012d7-c90b-4f9c-9f00-1657367350c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92ce4dc-127a-4254-a4d4-48a62f96d61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:54 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Volume 4a893c13-5480-4758-8b55-d251de756838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a893c13-5480-4758-8b55-d251de756838', 'volume_size': 1} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1886124829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a893c13-5480-4758-8b55-d251de756838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e819a3743a8c42dbbf581d3be1448419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:54Z,use_quota=True,user_id='7959f63c1f814ce4a12e56c40708b754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Creating volume 4a893c13-5480-4758-8b55-d251de756838 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:15:54 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:15:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:54 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838 1073741824 Jul 03 01:15:54 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:56 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838 1073741824" returned: 0 in 2.023s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:56 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:15:56 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838 Jul 03 01:15:56 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Flow 'volume_create_manager' (12e09611-460d-418a-a0ee-0ac2a16f4128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7974969-fe1a-4ea6-82b5-ed412e1722f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7974969-fe1a-4ea6-82b5-ed412e1722f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1827567710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d51e9c-159a-479e-acd4-64774a47d8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb08ee5a47a5450495adc9f4d83170b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:57Z,use_quota=True,user_id='852cbce65e1d46df8f35389db027ef53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c35917-e6d2-4799-b844-3948871e3c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c35917-e6d2-4799-b844-3948871e3c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f44e1b-77da-49b8-b05c-5d50f9a2468c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f44e1b-77da-49b8-b05c-5d50f9a2468c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d51e9c-159a-479e-acd4-64774a47d8b2', 'volume_name': 'volume-29d51e9c-159a-479e-acd4-64774a47d8b2', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71a054d-10e7-4bb9-9191-c0a7fbe3c58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71a054d-10e7-4bb9-9191-c0a7fbe3c58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50fadaa-8ad3-4fd9-ad70-278ee4039b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:57 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Volume 29d51e9c-159a-479e-acd4-64774a47d8b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d51e9c-159a-479e-acd4-64774a47d8b2', 'volume_size': 1} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:57 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838" returned: 0 in 1.036s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] <== create_volume: return (3244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.248s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1827567710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d51e9c-159a-479e-acd4-64774a47d8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb08ee5a47a5450495adc9f4d83170b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:57Z,use_quota=True,user_id='852cbce65e1d46df8f35389db027ef53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Creating volume 29d51e9c-159a-479e-acd4-64774a47d8b2 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:15:57 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92ce4dc-127a-4254-a4d4-48a62f96d61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a893c13-5480-4758-8b55-d251de756838', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:57 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b777f7a-405d-4915-bf6b-e811263aab08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:58 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Volume volume-4a893c13-5480-4758-8b55-d251de756838 (4a893c13-5480-4758-8b55-d251de756838): created successfully Jul 03 01:15:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b777f7a-405d-4915-bf6b-e811263aab08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:58 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2 1073741824 Jul 03 01:15:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Flow 'volume_create_manager' (bfb686ee-6807-4fd7-bb9e-1ed240fcb974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:58 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:58 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ca986ec7-f9d5-44ee-b6cb-7f9f7ab6e404 tempest-SnapshotMetadataTestJSON-2078873971 None] Created volume successfully. Jul 03 01:15:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:59 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2 1073741824" returned: 0 in 1.625s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:59 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2 Jul 03 01:15:59 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:00 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2" returned: 0 in 1.230s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] <== create_volume: return (2915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.918s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.431s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] Creating offline snapshot ab7e4e31-9445-4689-96fa-426a5cf7208d of volume 4a893c13-5480-4758-8b55-d251de756838 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:16:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50fadaa-8ad3-4fd9-ad70-278ee4039b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d51e9c-159a-479e-acd4-64774a47d8b2', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b59b02-78d9-4289-bafc-1244450db792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:00 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd5b07a-8a28-4881-b7c3-128b3d97f9f5]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:01 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Volume volume-29d51e9c-159a-479e-acd4-64774a47d8b2 (29d51e9c-159a-479e-acd4-64774a47d8b2): created successfully Jul 03 01:16:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b59b02-78d9-4289-bafc-1244450db792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Flow 'volume_create_manager' (12e09611-460d-418a-a0ee-0ac2a16f4128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:01 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-adb3d6bb-88a7-43db-a20e-083ebd036003 tempest-TestMinimumBasicScenario-804251199 None] Created volume successfully. Jul 03 01:16:01 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838 Jul 03 01:16:01 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:02 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838" returned: 0 in 1.288s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:02 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d 1G Jul 03 01:16:02 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:03 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d 1G" returned: 0 in 1.149s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a893c13-5480-4758-8b55-d251de756838 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:03 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a893c13-5480-4758-8b55-d251de756838 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d Jul 03 01:16:03 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:04 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a893c13-5480-4758-8b55-d251de756838 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d" returned: 0 in 0.886s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:04 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d is being set with open permissions: ugo+rw Jul 03 01:16:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:04 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d Jul 03 01:16:04 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:05 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d" returned: 0 in 0.875s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:05 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.info Jul 03 01:16:05 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-a0fead74-5ac4-4397-9135-6d31c9b19614 req-cdae5949-f7f0-4368-a811-c38f0dee0f26 tempest-TestMinimumBasicScenario-804251199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:06 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.info" returned: 0 in 0.895s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:06 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.info is being set with open permissions: ugo+rw Jul 03 01:16:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:06 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.info Jul 03 01:16:06 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:06 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.info" returned: 0 in 0.691s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.957s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-a0fead74-5ac4-4397-9135-6d31c9b19614 req-cdae5949-f7f0-4368-a811-c38f0dee0f26 tempest-TestMinimumBasicScenario-804251199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.094s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:06 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b33703-cfce-4317-bcba-62a089978a16]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-a0fead74-5ac4-4397-9135-6d31c9b19614 req-cdae5949-f7f0-4368-a811-c38f0dee0f26 tempest-TestMinimumBasicScenario-804251199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:06 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-732f9b1c-80d0-42e2-bf11-dedb28bd7880 tempest-SnapshotMetadataTestJSON-2078873971 None] Create snapshot completed successfully Jul 03 01:16:06 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2 Jul 03 01:16:06 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:07 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-a0fead74-5ac4-4397-9135-6d31c9b19614 req-cdae5949-f7f0-4368-a811-c38f0dee0f26 tempest-TestMinimumBasicScenario-804251199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2" returned: 0 in 1.015s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-a0fead74-5ac4-4397-9135-6d31c9b19614 req-cdae5949-f7f0-4368-a811-c38f0dee0f26 tempest-TestMinimumBasicScenario-804251199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.042s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-a0fead74-5ac4-4397-9135-6d31c9b19614 req-cdae5949-f7f0-4368-a811-c38f0dee0f26 tempest-TestMinimumBasicScenario-804251199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-29d51e9c-159a-479e-acd4-64774a47d8b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd666f8b3-a8c7-4519-9cda-4d8ae853ae7d', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:16:08 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-a0fead74-5ac4-4397-9135-6d31c9b19614 req-cdae5949-f7f0-4368-a811-c38f0dee0f26 tempest-TestMinimumBasicScenario-804251199 None] attachment_update completed successfully. Jul 03 01:16:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Acquiring lock "cinder-ab7e4e31-9445-4689-96fa-426a5cf7208d-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "cinder-ab7e4e31-9445-4689-96fa-426a5cf7208d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Acquiring lock "cinder-quobyte-4a893c13-5480-4758-8b55-d251de756838" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "cinder-quobyte-4a893c13-5480-4758-8b55-d251de756838" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Acquiring lock "cinder-quobyte-ab7e4e31-9445-4689-96fa-426a5cf7208d" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "cinder-quobyte-ab7e4e31-9445-4689-96fa-426a5cf7208d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Deleting offline snapshot ab7e4e31-9445-4689-96fa-426a5cf7208d of volume 4a893c13-5480-4758-8b55-d251de756838 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:16:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] snapshot_file for this snap is: volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:16:09 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c160efb-6b0d-462a-a999-7f9b0f1f791a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:09 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d Jul 03 01:16:09 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:09 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d" returned: 0 in 0.909s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a893c13-5480-4758-8b55-d251de756838(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:16:09 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[02daf064-28b2-4a9d-8e4d-56136098869f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:10 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838 Jul 03 01:16:10 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:10 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838" returned: 0 in 0.946s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:10 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d Jul 03 01:16:10 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:12 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d" returned: 0 in 1.087s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:12 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d Jul 03 01:16:12 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:12 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838.ab7e4e31-9445-4689-96fa-426a5cf7208d" returned: 0 in 0.934s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "cinder-quobyte-ab7e4e31-9445-4689-96fa-426a5cf7208d" released by "_delete_snapshot" :: held 4.092s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "cinder-quobyte-4a893c13-5480-4758-8b55-d251de756838" released by "delete_snapshot" :: held 4.140s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:13 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Created reservations ['02123468-5b7a-4058-96d2-e8827283ce47', 'fdb22ada-5b0c-41a4-9bcd-e2daccacfb05', 'dfc08155-5619-424a-af82-5dbe327aed28', '103f2929-61fa-495a-a733-0bd7c3df2849'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Delete snapshot completed successfully. Jul 03 01:16:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-589df0a4-ddd9-40e0-8910-70386aff2d58 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "cinder-ab7e4e31-9445-4689-96fa-426a5cf7208d-delete_snapshot" released by "delete_snapshot" :: held 4.375s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Acquiring lock "cinder-4a893c13-5480-4758-8b55-d251de756838-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "cinder-4a893c13-5480-4758-8b55-d251de756838-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Acquiring lock "cinder-quobyte-4a893c13-5480-4758-8b55-d251de756838" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "cinder-quobyte-4a893c13-5480-4758-8b55-d251de756838" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:14 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62fda67-86e8-4418-86ad-25e078cb1e34]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:14 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838 Jul 03 01:16:14 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:15 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838" returned: 0 in 1.031s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:15 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838 Jul 03 01:16:15 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:16 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a893c13-5480-4758-8b55-d251de756838" returned: 0 in 0.829s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "cinder-quobyte-4a893c13-5480-4758-8b55-d251de756838" released by "delete_volume" :: held 1.945s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:16 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=64,cinder:INSERT=20,cinder:UPDATE=68,cinder:DELETE=5 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:16:16 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Created reservations ['c9dbe4b9-e1ba-482b-9f6a-6f3587b78d6a', 'c4bedee5-84d0-4cc5-b05d-6e4507829fba', '356d8d0f-6c31-44d1-902d-d97b7b082930', 'b2c50001-203f-4dea-b7eb-d83c6144c41a'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:16 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:16:16 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:17 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.875s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:17 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:16:17 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Deleted volume successfully. Jul 03 01:16:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f68def7f-ee54-4fad-a89f-880413a8a9d8 tempest-SnapshotMetadataTestJSON-2078873971 None] Lock "cinder-4a893c13-5480-4758-8b55-d251de756838-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:21 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Flow 'volume_create_manager' (717c8b7b-03de-471c-90fd-d633725a1b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476e9e14-cfa2-4030-ae66-490f43f3ab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476e9e14-cfa2-4030-ae66-490f43f3ab38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1149284206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c9f31a-0fac-4005-bc37-bc6e5782e92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1da60263f7f4c0ca4b7404231afadad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:22Z,use_quota=True,user_id='dcc89a0972354ee1af275a980c9858c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe96164d-b534-4cca-819d-5a7188b0371f),volume_type_id=fe96164d-b534-4cca-819d-5a7188b0371f)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b7dde3-827d-48f0-a4f7-5c249736388a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b7dde3-827d-48f0-a4f7-5c249736388a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f782b430-4b63-4c1a-a0cc-343ad232d503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f782b430-4b63-4c1a-a0cc-343ad232d503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2c9f31a-0fac-4005-bc37-bc6e5782e92e', 'volume_name': 'volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb526108-f635-4d28-adeb-d94c81d439c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb526108-f635-4d28-adeb-d94c81d439c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bba785-f404-42c6-aaa6-51b099ddce2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:22 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Volume d2c9f31a-0fac-4005-bc37-bc6e5782e92e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e', 'volume_size': 1} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1149284206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c9f31a-0fac-4005-bc37-bc6e5782e92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1da60263f7f4c0ca4b7404231afadad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:22Z,use_quota=True,user_id='dcc89a0972354ee1af275a980c9858c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe96164d-b534-4cca-819d-5a7188b0371f),volume_type_id=fe96164d-b534-4cca-819d-5a7188b0371f)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Creating volume d2c9f31a-0fac-4005-bc37-bc6e5782e92e {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:22 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:22 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e 1073741824 Jul 03 01:16:22 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Flow 'volume_create_manager' (0fc44e7b-6df0-431d-84d7-613ae7ab7d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3e6881-e50d-4f97-bcb4-354d4469d53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3e6881-e50d-4f97-bcb4-354d4469d53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1832980880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa03722b-ec6a-44a7-9bb6-2d91266a568f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1da60263f7f4c0ca4b7404231afadad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:23Z,use_quota=True,user_id='dcc89a0972354ee1af275a980c9858c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94bae1c3-4015-4900-b7f7-d84bd688610b),volume_type_id=94bae1c3-4015-4900-b7f7-d84bd688610b)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f217dae-b475-46f4-bf5b-9c287f23fb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f217dae-b475-46f4-bf5b-9c287f23fb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e3aac1-11e0-4c6e-b1cb-a545377cad3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e3aac1-11e0-4c6e-b1cb-a545377cad3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa03722b-ec6a-44a7-9bb6-2d91266a568f', 'volume_name': 'volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26a48ca-f8c4-4105-9b87-b4cd9e4472e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26a48ca-f8c4-4105-9b87-b4cd9e4472e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc60d8ac-aa9f-4355-84e5-f6b6339864b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:22 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Volume fa03722b-ec6a-44a7-9bb6-2d91266a568f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f', 'volume_size': 1} Jul 03 01:16:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:23 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e 1073741824" returned: 0 in 1.623s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:23 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e Jul 03 01:16:23 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:23 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Flow 'volume_create_manager' (f11a42ce-e9df-4c39-ab38-183f8eeecec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb2acf5-5155-44fc-9600-00c628547d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb2acf5-5155-44fc-9600-00c628547d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-717084262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be107d4-6d33-4c2c-a08e-331c5686795d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1da60263f7f4c0ca4b7404231afadad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:24Z,use_quota=True,user_id='dcc89a0972354ee1af275a980c9858c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46ede77f-6235-4644-811e-a5209f1be6e5),volume_type_id=46ede77f-6235-4644-811e-a5209f1be6e5)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218bd7a2-10bd-4ffa-a43f-2b6e7cf4a2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218bd7a2-10bd-4ffa-a43f-2b6e7cf4a2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca36320-eead-4208-8f62-a134ac0f0c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:24 devstack cinder-volume[86357]: DEBUG cinder.image.glance [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Creating Keystone auth plugin from conf {{(pid=86357) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:16:25 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e" returned: 0 in 1.601s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] <== create_volume: return (3347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.357s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.438s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1832980880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa03722b-ec6a-44a7-9bb6-2d91266a568f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1da60263f7f4c0ca4b7404231afadad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:23Z,use_quota=True,user_id='dcc89a0972354ee1af275a980c9858c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94bae1c3-4015-4900-b7f7-d84bd688610b),volume_type_id=94bae1c3-4015-4900-b7f7-d84bd688610b)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Creating volume fa03722b-ec6a-44a7-9bb6-2d91266a568f {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:25 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bba785-f404-42c6-aaa6-51b099ddce2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:25 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f 1073741824 Jul 03 01:16:25 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a1acd1-e99b-4de4-b007-e4e8ac44effb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:25 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Volume volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e (d2c9f31a-0fac-4005-bc37-bc6e5782e92e): created successfully Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a1acd1-e99b-4de4-b007-e4e8ac44effb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Flow 'volume_create_manager' (717c8b7b-03de-471c-90fd-d633725a1b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca36320-eead-4208-8f62-a134ac0f0c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8be107d4-6d33-4c2c-a08e-331c5686795d', 'volume_name': 'volume-8be107d4-6d33-4c2c-a08e-331c5686795d', 'volume_size': 1, 'image_id': 'e44530d8-5914-40e4-8cd7-d90c860ae4f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e44530d8-5914-40e4-8cd7-d90c860ae4f7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1781291443', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1da60263f7f4c0ca4b7404231afadad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e44530d8-5914-40e4-8cd7-d90c860ae4f7', 'created_at': datetime.datetime(2026, 7, 2, 23, 16, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 16, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e44530d8-5914-40e4-8cd7-d90c860ae4f7/file', 'properties': {}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71616d62-b3c8-44ef-93fb-58cb6e2eeace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71616d62-b3c8-44ef-93fb-58cb6e2eeace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9fa996-6a04-4be3-9697-1533cfae655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:25 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Volume 8be107d4-6d33-4c2c-a08e-331c5686795d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8be107d4-6d33-4c2c-a08e-331c5686795d', 'volume_size': 1, 'image_id': 'e44530d8-5914-40e4-8cd7-d90c860ae4f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e44530d8-5914-40e4-8cd7-d90c860ae4f7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1781291443', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1da60263f7f4c0ca4b7404231afadad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e44530d8-5914-40e4-8cd7-d90c860ae4f7', 'created_at': datetime.datetime(2026, 7, 2, 23, 16, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 16, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e44530d8-5914-40e4-8cd7-d90c860ae4f7/file', 'properties': {}}, 'image_service': } Jul 03 01:16:25 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Trying to clone 8be107d4-6d33-4c2c-a08e-331c5686795d from image e44530d8-5914-40e4-8cd7-d90c860ae4f7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e44530d8-5914-40e4-8cd7-d90c860ae4f7', 'metadata': {}}]). {{(pid=86357) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:16:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-503c9b23-fa5e-492b-82fa-7b60bb45b84d tempest-TestInstancesWithCinderVolumes-14527428 None] Created volume successfully. Jul 03 01:16:26 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Flow 'volume_create_manager' (c3e0b248-cb8b-41b0-bf1d-a8ce71d752a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b778ced4-f02c-408e-938b-0988309b2a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b778ced4-f02c-408e-938b-0988309b2a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-213216579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83cd6f42-a233-41cd-a450-fc5917940e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f156866950034d96a2998c1e10803642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:26Z,use_quota=True,user_id='60e709cc6e0749a2ba47ccf55e45e774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04282d41-f803-4ca0-9917-6e413e747d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04282d41-f803-4ca0-9917-6e413e747d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e70b491-37ea-4d9d-a765-3f8885460ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e70b491-37ea-4d9d-a765-3f8885460ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83cd6f42-a233-41cd-a450-fc5917940e0f', 'volume_name': 'volume-83cd6f42-a233-41cd-a450-fc5917940e0f', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc7bdb7-c712-49ec-8bb2-0628708fe6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc7bdb7-c712-49ec-8bb2-0628708fe6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2512920c-45b6-4c00-acaf-e0cf1c242418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:26 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Volume 83cd6f42-a233-41cd-a450-fc5917940e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83cd6f42-a233-41cd-a450-fc5917940e0f', 'volume_size': 1} Jul 03 01:16:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:27 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f 1073741824" returned: 0 in 2.008s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:27 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f Jul 03 01:16:27 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:16:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:27 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:16:27 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:28 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f" returned: 0 in 1.209s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] <== create_volume: return (3319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.326s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.202s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-213216579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83cd6f42-a233-41cd-a450-fc5917940e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f156866950034d96a2998c1e10803642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:26Z,use_quota=True,user_id='60e709cc6e0749a2ba47ccf55e45e774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Creating volume 83cd6f42-a233-41cd-a450-fc5917940e0f {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:28 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83cd6f42-a233-41cd-a450-fc5917940e0f 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc60d8ac-aa9f-4355-84e5-f6b6339864b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e37122-3e0e-4598-80e9-eb8a2bbc3dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:28 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83cd6f42-a233-41cd-a450-fc5917940e0f 1073741824 Jul 03 01:16:28 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:28 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Volume volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f (fa03722b-ec6a-44a7-9bb6-2d91266a568f): created successfully Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e37122-3e0e-4598-80e9-eb8a2bbc3dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Flow 'volume_create_manager' (0fc44e7b-6df0-431d-84d7-613ae7ab7d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:28 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6f39d13e-8822-4387-b129-34c60e0da8ca tempest-TestInstancesWithCinderVolumes-14527428 None] Created volume successfully. Jul 03 01:16:29 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.532s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:29 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:16:29 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:16:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:16:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:16:30 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83cd6f42-a233-41cd-a450-fc5917940e0f 1073741824" returned: 0 in 1.390s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83cd6f42-a233-41cd-a450-fc5917940e0f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:30 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83cd6f42-a233-41cd-a450-fc5917940e0f Jul 03 01:16:30 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:30 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD, size 20.69 MB, duration 4.97 sec {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:16:30 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Image download 20.69 MB at 4.16 MB/s Jul 03 01:16:30 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ec3b2e-a25c-4bf5-afde-ca3f7bafde3e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:31 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83cd6f42-a233-41cd-a450-fc5917940e0f" returned: 0 in 0.824s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] <== create_volume: return (2272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.280s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:31 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD Jul 03 01:16:31 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2512920c-45b6-4c00-acaf-e0cf1c242418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83cd6f42-a233-41cd-a450-fc5917940e0f', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9834af0b-76f8-44da-9aea-4abdf77dab4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:31 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Volume volume-83cd6f42-a233-41cd-a450-fc5917940e0f (83cd6f42-a233-41cd-a450-fc5917940e0f): created successfully Jul 03 01:16:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9834af0b-76f8-44da-9aea-4abdf77dab4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Flow 'volume_create_manager' (c3e0b248-cb8b-41b0-bf1d-a8ce71d752a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:31 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-263270b6-c5bb-4c14-839c-f7fb123bf3f3 tempest-VolumesTransfersV355Test-1170377730 None] Created volume successfully. Jul 03 01:16:31 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD" returned: 0 in 1.039s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:31 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Temporary image e44530d8-5914-40e4-8cd7-d90c860ae4f7 is fetched for user dcc89a0972354ee1af275a980c9858c6. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[249e424d-8f4c-42bf-b544-b11f437925b8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:32 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD Jul 03 01:16:32 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:32 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b197df8a-6cf2-4452-b050-f9183e1b53f4 tempest-VolumesTransfersV355Test-1816577934 None] Transfer volume completed successfully. Jul 03 01:16:32 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD" returned: 0 in 0.795s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-717084262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be107d4-6d33-4c2c-a08e-331c5686795d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1da60263f7f4c0ca4b7404231afadad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:24Z,use_quota=True,user_id='dcc89a0972354ee1af275a980c9858c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46ede77f-6235-4644-811e-a5209f1be6e5),volume_type_id=46ede77f-6235-4644-811e-a5209f1be6e5)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Creating volume 8be107d4-6d33-4c2c-a08e-331c5686795d {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:32 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:16:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:32 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d 1073741824 Jul 03 01:16:32 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Acquiring lock "cinder-83cd6f42-a233-41cd-a450-fc5917940e0f-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Lock "cinder-83cd6f42-a233-41cd-a450-fc5917940e0f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Acquiring lock "cinder-quobyte-83cd6f42-a233-41cd-a450-fc5917940e0f" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Lock "cinder-quobyte-83cd6f42-a233-41cd-a450-fc5917940e0f" acquired by "delete_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:33 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[78417a8e-aab0-471e-b462-a35998c077c5]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83cd6f42-a233-41cd-a450-fc5917940e0f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:33 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83cd6f42-a233-41cd-a450-fc5917940e0f Jul 03 01:16:33 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:33 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d 1073741824" returned: 0 in 1.069s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:34 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d Jul 03 01:16:34 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:34 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83cd6f42-a233-41cd-a450-fc5917940e0f" returned: 0 in 1.155s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83cd6f42-a233-41cd-a450-fc5917940e0f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:34 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83cd6f42-a233-41cd-a450-fc5917940e0f Jul 03 01:16:34 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:34 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d" returned: 0 in 0.947s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:35 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Attempting download of e44530d8-5914-40e4-8cd7-d90c860ae4f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/e44530d8-5914-40e4-8cd7-d90c860ae4f7', 'metadata': {}}])) to volume 8be107d4-6d33-4c2c-a08e-331c5686795d. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:16:35 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[592f4dfd-bb4e-4798-8158-0624be7914d6]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wnpy56tw {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:35 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wnpy56tw Jul 03 01:16:35 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:36 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83cd6f42-a233-41cd-a450-fc5917940e0f" returned: 0 in 1.183s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:36 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wnpy56tw" returned: 0 in 1.044s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wnpy56tw {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Lock "cinder-quobyte-83cd6f42-a233-41cd-a450-fc5917940e0f" released by "delete_volume" :: held 2.427s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:36 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Created reservations ['44526772-9171-4e37-a009-f576a225da27', 'f6db2c4d-6a3d-47dd-8afd-f9e87397a665', '30a86d73-724c-4470-8ee4-95a22b68ab44', '28b06c79-75c3-4d42-b98c-d96a2b113b05'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:36 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wnpy56tw Jul 03 01:16:36 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:36 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:16:36 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:37 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wnpy56tw" returned: 1 in 0.944s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wnpy56tw' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c34c4a-2985-4923-915a-f1faa2ffdf7c]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:37 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.820s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:16:37 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Deleted volume successfully. Jul 03 01:16:37 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD Jul 03 01:16:37 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d59ecb42-09c9-45a9-84fd-19decb394980 tempest-VolumesTransfersV355Test-1735997278 None] Lock "cinder-83cd6f42-a233-41cd-a450-fc5917940e0f-delete_volume" released by "delete_volume" :: held 3.632s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Flow 'volume_create_manager' (d00c3acf-6095-4280-816a-746a11b35b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8320847-5daf-4448-a4df-0213728bdd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8320847-5daf-4448-a4df-0213728bdd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-803389446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99196cd-e405-41af-9afd-97370f8cb9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f156866950034d96a2998c1e10803642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:38Z,use_quota=True,user_id='60e709cc6e0749a2ba47ccf55e45e774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cb5dec-11a9-47e0-a946-2e0312f14ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cb5dec-11a9-47e0-a946-2e0312f14ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84371c16-3a85-48a1-afe0-50ab8b82d7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84371c16-3a85-48a1-afe0-50ab8b82d7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e99196cd-e405-41af-9afd-97370f8cb9c6', 'volume_name': 'volume-e99196cd-e405-41af-9afd-97370f8cb9c6', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13bea36-37cb-4f91-922f-09f84d655c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13bea36-37cb-4f91-922f-09f84d655c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9737f44a-7b91-483f-8d7e-7d5eecf16a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:37 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Volume e99196cd-e405-41af-9afd-97370f8cb9c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e99196cd-e405-41af-9afd-97370f8cb9c6', 'volume_size': 1} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-803389446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99196cd-e405-41af-9afd-97370f8cb9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f156866950034d96a2998c1e10803642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:38Z,use_quota=True,user_id='60e709cc6e0749a2ba47ccf55e45e774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Creating volume e99196cd-e405-41af-9afd-97370f8cb9c6 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:37 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e99196cd-e405-41af-9afd-97370f8cb9c6 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:37 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e99196cd-e405-41af-9afd-97370f8cb9c6 1073741824 Jul 03 01:16:37 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:37 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD" returned: 0 in 0.899s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] e44530d8-5914-40e4-8cd7-d90c860ae4f7 was qcow2, converting to raw {{(pid=86357) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:16:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:38 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d Jul 03 01:16:38 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:38 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e99196cd-e405-41af-9afd-97370f8cb9c6 1073741824" returned: 0 in 0.942s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e99196cd-e405-41af-9afd-97370f8cb9c6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:38 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e99196cd-e405-41af-9afd-97370f8cb9c6 Jul 03 01:16:38 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:39 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e99196cd-e405-41af-9afd-97370f8cb9c6" returned: 0 in 0.710s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9737f44a-7b91-483f-8d7e-7d5eecf16a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e99196cd-e405-41af-9afd-97370f8cb9c6', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1238afbe-a473-4a7b-a407-397f2e01de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:39 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Volume volume-e99196cd-e405-41af-9afd-97370f8cb9c6 (e99196cd-e405-41af-9afd-97370f8cb9c6): created successfully Jul 03 01:16:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1238afbe-a473-4a7b-a407-397f2e01de8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Flow 'volume_create_manager' (d00c3acf-6095-4280-816a-746a11b35b49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:39 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9657c3f8-1b6d-43b1-84f5-92981152b495 tempest-VolumesTransfersV355Test-1170377730 None] Created volume successfully. Jul 03 01:16:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Acquiring lock "cinder-e99196cd-e405-41af-9afd-97370f8cb9c6-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Lock "cinder-e99196cd-e405-41af-9afd-97370f8cb9c6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Acquiring lock "cinder-quobyte-e99196cd-e405-41af-9afd-97370f8cb9c6" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Lock "cinder-quobyte-e99196cd-e405-41af-9afd-97370f8cb9c6" acquired by "delete_volume" :: waited 0.035s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:40 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb91bd2d-c631-44df-b78a-bcc923b6e486]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e99196cd-e405-41af-9afd-97370f8cb9c6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:40 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d" returned: 0 in 2.538s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:40 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e44530d8-5914-40e4-8cd7-d90c860ae4f7_wy7ffgyjdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:16:40 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Converted 112.00 MB image at 44.10 MB/s Jul 03 01:16:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:40 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d 1G Jul 03 01:16:40 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:40 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e99196cd-e405-41af-9afd-97370f8cb9c6 Jul 03 01:16:40 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:41 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d 1G" returned: 0 in 0.718s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:41 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1eef2e-610b-4202-ba31-f6a34f9e76ed]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:41 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e99196cd-e405-41af-9afd-97370f8cb9c6" returned: 0 in 0.924s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e99196cd-e405-41af-9afd-97370f8cb9c6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:41 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d Jul 03 01:16:41 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:41 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e99196cd-e405-41af-9afd-97370f8cb9c6 Jul 03 01:16:41 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:42 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d" returned: 0 in 0.807s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:42 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e99196cd-e405-41af-9afd-97370f8cb9c6" returned: 0 in 0.777s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Lock "cinder-quobyte-e99196cd-e405-41af-9afd-97370f8cb9c6" released by "delete_volume" :: held 1.772s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:42 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d Jul 03 01:16:42 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:42 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Created reservations ['d76cad89-6c1d-46b9-9b2c-6f1ea83e60ef', '2266147e-a88f-48c5-9179-75f3723f1066', 'e5496a41-e9d8-4892-b842-fd4cf00d0d3f', '3f023cbf-b7ca-4e7f-8573-7edad8ae231c'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:42 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:16:42 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:43 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d" returned: 1 in 0.914s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Downloaded image e44530d8-5914-40e4-8cd7-d90c860ae4f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/e44530d8-5914-40e4-8cd7-d90c860ae4f7', 'metadata': {}}])) to volume 8be107d4-6d33-4c2c-a08e-331c5686795d successfully. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Temporary image e44530d8-5914-40e4-8cd7-d90c860ae4f7 for user dcc89a0972354ee1af275a980c9858c6 is deleted. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Marking volume 8be107d4-6d33-4c2c-a08e-331c5686795d as bootable. {{(pid=86357) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Copying metadata from image e44530d8-5914-40e4-8cd7-d90c860ae4f7 to 8be107d4-6d33-4c2c-a08e-331c5686795d. {{(pid=86357) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Creating volume glance metadata for volume 8be107d4-6d33-4c2c-a08e-331c5686795d backed by image e44530d8-5914-40e4-8cd7-d90c860ae4f7 with: {'image_id': 'e44530d8-5914-40e4-8cd7-d90c860ae4f7', 'image_name': 'tempest-scenario-img--1781291443', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86357) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=66,cinder:SELECT=50,cinder:DELETE=4,cinder:INSERT=13 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:16:43 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.872s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:16:43 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Deleted volume successfully. Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9fa996-6a04-4be3-9697-1533cfae655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be107d4-6d33-4c2c-a08e-331c5686795d', 'volume_size': 1, 'image_id': 'e44530d8-5914-40e4-8cd7-d90c860ae4f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e44530d8-5914-40e4-8cd7-d90c860ae4f7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1781291443', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1da60263f7f4c0ca4b7404231afadad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e44530d8-5914-40e4-8cd7-d90c860ae4f7', 'created_at': datetime.datetime(2026, 7, 2, 23, 16, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 16, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e44530d8-5914-40e4-8cd7-d90c860ae4f7/file', 'properties': {}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e70ff3-cec2-48cc-9dda-8ad2ee25c34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ea880650-5a25-4d25-925c-b1cec25ac3a4 tempest-VolumesTransfersV355Test-1735997278 None] Lock "cinder-e99196cd-e405-41af-9afd-97370f8cb9c6-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:43 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Volume volume-8be107d4-6d33-4c2c-a08e-331c5686795d (8be107d4-6d33-4c2c-a08e-331c5686795d): created successfully Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e70ff3-cec2-48cc-9dda-8ad2ee25c34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Flow 'volume_create_manager' (f11a42ce-e9df-4c39-ab38-183f8eeecec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:43 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-96a2bab1-1c88-4194-a3e9-5a632331fe58 tempest-TestInstancesWithCinderVolumes-14527428 None] Created volume successfully. Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Flow 'volume_create_manager' (b3a8d758-602f-4aa7-9e36-1ae3ea439ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72b4bca-d3c7-4609-a9ea-72b0523ef8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72b4bca-d3c7-4609-a9ea-72b0523ef8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1815182011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24a0c47-258e-405e-8f4c-192c9a6ef41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4e13c0646e41cdbdfe478d955db0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:48Z,use_quota=True,user_id='8e6f73bbb55c4c499e6b2be6cd2e7ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3e1e31-5da4-49f2-9bb4-ad7e64064b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3e1e31-5da4-49f2-9bb4-ad7e64064b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3868a14e-7670-4940-a327-bf2ccee27d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3868a14e-7670-4940-a327-bf2ccee27d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24a0c47-258e-405e-8f4c-192c9a6ef41b', 'volume_name': 'volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09aa886a-e9ad-41a3-bb54-56e9dfd2e0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09aa886a-e9ad-41a3-bb54-56e9dfd2e0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f3abce-d9e7-48fd-b988-72a76bdd4dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:47 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Volume d24a0c47-258e-405e-8f4c-192c9a6ef41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b', 'volume_size': 1} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1815182011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24a0c47-258e-405e-8f4c-192c9a6ef41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4e13c0646e41cdbdfe478d955db0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:48Z,use_quota=True,user_id='8e6f73bbb55c4c499e6b2be6cd2e7ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Creating volume d24a0c47-258e-405e-8f4c-192c9a6ef41b {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:47 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:16:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:47 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b 1073741824 Jul 03 01:16:47 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:48 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b 1073741824" returned: 0 in 0.968s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:48 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b Jul 03 01:16:48 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:49 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b" returned: 0 in 0.749s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f3abce-d9e7-48fd-b988-72a76bdd4dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891ebab4-0d59-40ef-88fb-cf750ffee0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:49 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Volume volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b (d24a0c47-258e-405e-8f4c-192c9a6ef41b): created successfully Jul 03 01:16:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891ebab4-0d59-40ef-88fb-cf750ffee0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Flow 'volume_create_manager' (b3a8d758-602f-4aa7-9e36-1ae3ea439ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:49 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-73d775ca-9c35-4807-8df2-62ac62da6c83 tempest-AttachVolumeNegativeTest-509862070 None] Created volume successfully. Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-a6f7fb06-54a8-4272-9fed-de49710991d7 req-86dda7a9-087a-4e6d-8a5b-d01268220a04 tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-a6f7fb06-54a8-4272-9fed-de49710991d7 req-86dda7a9-087a-4e6d-8a5b-d01268220a04 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[1678d8c7-1357-49b9-9f66-dba7eea524e3]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-a6f7fb06-54a8-4272-9fed-de49710991d7 req-86dda7a9-087a-4e6d-8a5b-d01268220a04 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:52 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d Jul 03 01:16:52 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Flow 'volume_create_manager' (c3ee4ccc-b2a2-451c-a0ec-f8f25ea5dfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8436945-3964-42fd-8a15-24c8ac610c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8436945-3964-42fd-8a15-24c8ac610c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1927433684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a5748f-7e9c-434e-b782-7c374c29f4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd866412532d4aa1b111e84f51d0ddbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:52Z,use_quota=True,user_id='e2de153eab2644e7bb6f44ae0cca37d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd23c9e-c83e-4b08-9fa8-8919b021de01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd23c9e-c83e-4b08-9fa8-8919b021de01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5a3fb0-3614-40d8-ba52-d4bce2174452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5a3fb0-3614-40d8-ba52-d4bce2174452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90a5748f-7e9c-434e-b782-7c374c29f4c2', 'volume_name': 'volume-90a5748f-7e9c-434e-b782-7c374c29f4c2', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69054cad-0f40-4a0c-8078-2dfe7741998f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69054cad-0f40-4a0c-8078-2dfe7741998f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f52f6d-df11-4627-befd-2c33ea2efc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:52 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Volume 90a5748f-7e9c-434e-b782-7c374c29f4c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90a5748f-7e9c-434e-b782-7c374c29f4c2', 'volume_size': 1} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:52 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-a6f7fb06-54a8-4272-9fed-de49710991d7 req-86dda7a9-087a-4e6d-8a5b-d01268220a04 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d" returned: 0 in 0.892s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-a6f7fb06-54a8-4272-9fed-de49710991d7 req-86dda7a9-087a-4e6d-8a5b-d01268220a04 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:53 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d Jul 03 01:16:53 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-7a386d35-d345-4c75-9cd8-250db37dfce1 req-525cd1d5-d720-4c04-bee6-9bc955b2c20e tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:53 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-a6f7fb06-54a8-4272-9fed-de49710991d7 req-86dda7a9-087a-4e6d-8a5b-d01268220a04 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d" returned: 1 in 0.751s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-a6f7fb06-54a8-4272-9fed-de49710991d7 req-86dda7a9-087a-4e6d-8a5b-d01268220a04 tempest-TestInstancesWithCinderVolumes-14527428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-a6f7fb06-54a8-4272-9fed-de49710991d7 req-86dda7a9-087a-4e6d-8a5b-d01268220a04 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.692s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.060s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1927433684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a5748f-7e9c-434e-b782-7c374c29f4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd866412532d4aa1b111e84f51d0ddbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:52Z,use_quota=True,user_id='e2de153eab2644e7bb6f44ae0cca37d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Creating volume 90a5748f-7e9c-434e-b782-7c374c29f4c2 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:53 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-90a5748f-7e9c-434e-b782-7c374c29f4c2 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:53 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-90a5748f-7e9c-434e-b782-7c374c29f4c2 1073741824 Jul 03 01:16:53 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-a6f7fb06-54a8-4272-9fed-de49710991d7 req-86dda7a9-087a-4e6d-8a5b-d01268220a04 tempest-TestInstancesWithCinderVolumes-14527428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-8be107d4-6d33-4c2c-a08e-331c5686795d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf5aff79-755b-4fe3-96bf-7335c5e9e899', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:16:53 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-a6f7fb06-54a8-4272-9fed-de49710991d7 req-86dda7a9-087a-4e6d-8a5b-d01268220a04 tempest-TestInstancesWithCinderVolumes-14527428 None] attachment_update completed successfully. Jul 03 01:16:54 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-90a5748f-7e9c-434e-b782-7c374c29f4c2 1073741824" returned: 0 in 0.805s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-90a5748f-7e9c-434e-b782-7c374c29f4c2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:54 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-90a5748f-7e9c-434e-b782-7c374c29f4c2 Jul 03 01:16:54 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:55 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-90a5748f-7e9c-434e-b782-7c374c29f4c2" returned: 0 in 0.749s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-7a386d35-d345-4c75-9cd8-250db37dfce1 req-525cd1d5-d720-4c04-bee6-9bc955b2c20e tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.064s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f52f6d-df11-4627-befd-2c33ea2efc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a5748f-7e9c-434e-b782-7c374c29f4c2', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769062b8-7426-49f8-8941-a3253e992dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:55 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9b6f29-9939-48ee-b6f6-8f9a4b613355]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-7a386d35-d345-4c75-9cd8-250db37dfce1 req-525cd1d5-d720-4c04-bee6-9bc955b2c20e tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:55 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Volume volume-90a5748f-7e9c-434e-b782-7c374c29f4c2 (90a5748f-7e9c-434e-b782-7c374c29f4c2): created successfully Jul 03 01:16:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769062b8-7426-49f8-8941-a3253e992dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Flow 'volume_create_manager' (c3ee4ccc-b2a2-451c-a0ec-f8f25ea5dfe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:55 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4f9eb884-45f1-40d6-bcf6-e0e791dc91cf tempest-VolumesNegativeTest-638461857 None] Created volume successfully. Jul 03 01:16:55 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b Jul 03 01:16:55 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:56 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-7a386d35-d345-4c75-9cd8-250db37dfce1 req-525cd1d5-d720-4c04-bee6-9bc955b2c20e tempest-AttachVolumeNegativeTest-509862070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b" returned: 0 in 0.746s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-7a386d35-d345-4c75-9cd8-250db37dfce1 req-525cd1d5-d720-4c04-bee6-9bc955b2c20e tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.770s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-7a386d35-d345-4c75-9cd8-250db37dfce1 req-525cd1d5-d720-4c04-bee6-9bc955b2c20e tempest-AttachVolumeNegativeTest-509862070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2a53921-d4f8-4844-a587-58c98a6e5018', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:16:56 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-7a386d35-d345-4c75-9cd8-250db37dfce1 req-525cd1d5-d720-4c04-bee6-9bc955b2c20e tempest-AttachVolumeNegativeTest-509862070 None] attachment_update completed successfully. Jul 03 01:17:02 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-e137ad56-27fc-42a1-af9a-5ef5c1453352 req-d15ad1ce-1485-44f7-a21f-f49792288208 tempest-AttachVolumeNegativeTest-509862070 None] Terminate volume connection completed successfully. Jul 03 01:17:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-e137ad56-27fc-42a1-af9a-5ef5c1453352 req-d15ad1ce-1485-44f7-a21f-f49792288208 tempest-AttachVolumeNegativeTest-509862070 None] Deleting attachment f2a53921-d4f8-4844-a587-58c98a6e5018. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:17:05 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-fb255697-2830-4a3f-bff3-6e815d544500 req-6ad40083-1e33-41a6-9906-dfb936662a13 tempest-TestMinimumBasicScenario-804251199 None] Terminate volume connection completed successfully. Jul 03 01:17:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-fb255697-2830-4a3f-bff3-6e815d544500 req-6ad40083-1e33-41a6-9906-dfb936662a13 tempest-TestMinimumBasicScenario-804251199 None] Deleting attachment d666f8b3-a8c7-4519-9cda-4d8ae853ae7d. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:17:09 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Acquiring lock "cinder-29d51e9c-159a-479e-acd4-64774a47d8b2-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:09 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Lock "cinder-29d51e9c-159a-479e-acd4-64774a47d8b2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:09 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Acquiring lock "cinder-quobyte-29d51e9c-159a-479e-acd4-64774a47d8b2" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:09 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Lock "cinder-quobyte-29d51e9c-159a-479e-acd4-64774a47d8b2" acquired by "delete_volume" :: waited 0.035s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:09 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc371de8-9b1d-42d7-9f88-e39e2d4aac57]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:09 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2 Jul 03 01:17:09 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:10 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2" returned: 0 in 1.742s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:11 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2 Jul 03 01:17:11 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:13 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-29d51e9c-159a-479e-acd4-64774a47d8b2" returned: 0 in 2.511s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Lock "cinder-quobyte-29d51e9c-159a-479e-acd4-64774a47d8b2" released by "delete_volume" :: held 4.406s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:13 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Created reservations ['52c7e2e4-350d-49d8-b449-978a3c944e10', 'afa0e9c0-3f98-43ae-83e9-a09b14181b08', 'afdf7c98-a32c-49b7-949f-2dec6544197a', '490defbb-f691-4863-a179-2fa7e1f6ed0d'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:17:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:14 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:17:14 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:15 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.496s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:15 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:17:15 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Deleted volume successfully. Jul 03 01:17:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-788b6511-edec-4774-8c6b-8d760c1582df tempest-TestMinimumBasicScenario-804251199 None] Lock "cinder-29d51e9c-159a-479e-acd4-64774a47d8b2-delete_volume" released by "delete_volume" :: held 6.484s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:23 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:INSERT=19,cinder:UPDATE=58,cinder:SELECT=51,cinder:DELETE=7 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:17:25 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=16,cinder:SELECT=23,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:17:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:17:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:27 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:17:27 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:28 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.854s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:17:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:17:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:17:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:17:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-38a20831-8052-432b-b64e-c5aea78cf24c req-1eb509da-81f3-45b8-bdda-9572d8d009ab tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-38a20831-8052-432b-b64e-c5aea78cf24c req-1eb509da-81f3-45b8-bdda-9572d8d009ab tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:30 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[da14136e-5d72-44d0-8bea-e950a1e329f5]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-38a20831-8052-432b-b64e-c5aea78cf24c req-1eb509da-81f3-45b8-bdda-9572d8d009ab tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:30 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e Jul 03 01:17:30 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:31 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-38a20831-8052-432b-b64e-c5aea78cf24c req-1eb509da-81f3-45b8-bdda-9572d8d009ab tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e" returned: 0 in 1.225s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-38a20831-8052-432b-b64e-c5aea78cf24c req-1eb509da-81f3-45b8-bdda-9572d8d009ab tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.245s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-38a20831-8052-432b-b64e-c5aea78cf24c req-1eb509da-81f3-45b8-bdda-9572d8d009ab tempest-TestInstancesWithCinderVolumes-14527428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a025575-0c60-451e-abbd-c2e4dfd81491', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:17:32 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-38a20831-8052-432b-b64e-c5aea78cf24c req-1eb509da-81f3-45b8-bdda-9572d8d009ab tempest-TestInstancesWithCinderVolumes-14527428 None] attachment_update completed successfully. Jul 03 01:17:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Acquiring lock "cinder-90a5748f-7e9c-434e-b782-7c374c29f4c2-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Lock "cinder-90a5748f-7e9c-434e-b782-7c374c29f4c2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Acquiring lock "cinder-quobyte-90a5748f-7e9c-434e-b782-7c374c29f4c2" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Lock "cinder-quobyte-90a5748f-7e9c-434e-b782-7c374c29f4c2" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:34 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eb20d3-781b-4f66-9c8f-ec7f9fb8bf32]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-90a5748f-7e9c-434e-b782-7c374c29f4c2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:34 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-90a5748f-7e9c-434e-b782-7c374c29f4c2 Jul 03 01:17:34 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:35 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-90a5748f-7e9c-434e-b782-7c374c29f4c2" returned: 0 in 0.835s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-90a5748f-7e9c-434e-b782-7c374c29f4c2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:35 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-90a5748f-7e9c-434e-b782-7c374c29f4c2 Jul 03 01:17:35 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:36 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-90a5748f-7e9c-434e-b782-7c374c29f4c2" returned: 0 in 0.808s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Lock "cinder-quobyte-90a5748f-7e9c-434e-b782-7c374c29f4c2" released by "delete_volume" :: held 1.719s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:36 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Created reservations ['9ecd4ab8-f652-4882-9cf3-686cacd517a8', '856e10dd-35e6-470d-900f-c6371982b8e9', '20a6d4f7-b290-4870-8e84-23457cad7b25', '7041948b-c18e-41f1-a6f0-01e2d89e6506'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:17:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:36 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:17:36 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:38 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.571s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:38 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:17:38 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Deleted volume successfully. Jul 03 01:17:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65279031-5ff1-4660-b043-27b829a9a823 tempest-VolumesNegativeTest-638461857 None] Lock "cinder-90a5748f-7e9c-434e-b782-7c374c29f4c2-delete_volume" released by "delete_volume" :: held 3.676s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-b46fed0e-8263-41c4-881f-cfbc676040e6 req-98131a71-a75b-4ea4-8deb-93abbd7db51a tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-b46fed0e-8263-41c4-881f-cfbc676040e6 req-98131a71-a75b-4ea4-8deb-93abbd7db51a tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:40 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1abfa27-ff3d-4b71-95c5-f22a6a334a91]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-b46fed0e-8263-41c4-881f-cfbc676040e6 req-98131a71-a75b-4ea4-8deb-93abbd7db51a tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:40 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f Jul 03 01:17:40 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:41 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-b46fed0e-8263-41c4-881f-cfbc676040e6 req-98131a71-a75b-4ea4-8deb-93abbd7db51a tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f" returned: 0 in 1.122s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-b46fed0e-8263-41c4-881f-cfbc676040e6 req-98131a71-a75b-4ea4-8deb-93abbd7db51a tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.159s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-b46fed0e-8263-41c4-881f-cfbc676040e6 req-98131a71-a75b-4ea4-8deb-93abbd7db51a tempest-TestInstancesWithCinderVolumes-14527428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cc1728c-41ae-45f5-b3ec-9d2564bb78fd', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:17:42 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-b46fed0e-8263-41c4-881f-cfbc676040e6 req-98131a71-a75b-4ea4-8deb-93abbd7db51a tempest-TestInstancesWithCinderVolumes-14527428 None] attachment_update completed successfully. Jul 03 01:17:52 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=16,cinder:UPDATE=12 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:17:52 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=16,cinder:UPDATE=10,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:17:53 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-6a54c995-9446-4683-ab75-016bc85aa8c9 req-3fb708ad-429b-4dab-b4bb-91ce7cc63f65 tempest-TestInstancesWithCinderVolumes-14527428 None] Terminate volume connection completed successfully. Jul 03 01:17:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-6a54c995-9446-4683-ab75-016bc85aa8c9 req-3fb708ad-429b-4dab-b4bb-91ce7cc63f65 tempest-TestInstancesWithCinderVolumes-14527428 None] Deleting attachment 5a025575-0c60-451e-abbd-c2e4dfd81491. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:17:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "cinder-d2c9f31a-0fac-4005-bc37-bc6e5782e92e-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "cinder-d2c9f31a-0fac-4005-bc37-bc6e5782e92e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "cinder-quobyte-d2c9f31a-0fac-4005-bc37-bc6e5782e92e" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "cinder-quobyte-d2c9f31a-0fac-4005-bc37-bc6e5782e92e" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:55 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbd6458-4b90-4b81-a798-e15d291c76e5]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:55 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e Jul 03 01:17:55 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:56 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e" returned: 0 in 1.230s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:56 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e Jul 03 01:17:56 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:57 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d2c9f31a-0fac-4005-bc37-bc6e5782e92e" returned: 0 in 0.884s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "cinder-quobyte-d2c9f31a-0fac-4005-bc37-bc6e5782e92e" released by "delete_volume" :: held 2.170s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:57 devstack cinder-volume[86357]: WARNING cinder.quota [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-160958788-361862008 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-160958788-361862008, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:17:57 devstack cinder-volume[86357]: WARNING cinder.quota [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-160958788-361862008 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-160958788-361862008, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:17:57 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Created reservations ['2806a398-2d3b-498f-b7bf-fddad3dae3fe', 'abbe9f3f-4b98-4634-86a6-e68b45e342b8', '285b4781-b4e0-4b9c-94d3-9c1d46be07d5', '75637083-ec32-4f04-a549-b5e174e01cb9'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:17:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:58 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:17:58 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:58 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.994s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:59 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:17:59 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Deleted volume successfully. Jul 03 01:17:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4706de10-847b-4406-8b1b-5bf78bdbcca1 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "cinder-d2c9f31a-0fac-4005-bc37-bc6e5782e92e-delete_volume" released by "delete_volume" :: held 3.522s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:01 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-c05562d2-9432-426e-ad70-f14ba218970f req-08db7d19-1585-4084-8f4a-c6301dedfbfe tempest-TestInstancesWithCinderVolumes-14527428 None] Terminate volume connection completed successfully. Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c05562d2-9432-426e-ad70-f14ba218970f req-08db7d19-1585-4084-8f4a-c6301dedfbfe tempest-TestInstancesWithCinderVolumes-14527428 None] Deleting attachment 0cc1728c-41ae-45f5-b3ec-9d2564bb78fd. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Flow 'volume_create_manager' (755ecc2b-fd96-4514-9815-ab9e5342f726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca34397-5090-40e8-a986-c7f6ee6739ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca34397-5090-40e8-a986-c7f6ee6739ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-573361439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c212da-a290-4ed0-ad53-cb24dada3bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4e13c0646e41cdbdfe478d955db0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:01Z,use_quota=True,user_id='8e6f73bbb55c4c499e6b2be6cd2e7ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e73ed8c-a41c-413d-ad38-652023ff3b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e73ed8c-a41c-413d-ad38-652023ff3b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46dd32f-3a71-472d-8097-1a1dd6bb0e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46dd32f-3a71-472d-8097-1a1dd6bb0e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c212da-a290-4ed0-ad53-cb24dada3bdc', 'volume_name': 'volume-46c212da-a290-4ed0-ad53-cb24dada3bdc', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7a4770-66a2-44a1-9bd0-371bb64941ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7a4770-66a2-44a1-9bd0-371bb64941ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f366a8-a69b-41e6-b54f-d2ccfbbd27e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:01 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Volume 46c212da-a290-4ed0-ad53-cb24dada3bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c212da-a290-4ed0-ad53-cb24dada3bdc', 'volume_size': 1} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-573361439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c212da-a290-4ed0-ad53-cb24dada3bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4e13c0646e41cdbdfe478d955db0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:01Z,use_quota=True,user_id='8e6f73bbb55c4c499e6b2be6cd2e7ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Creating volume 46c212da-a290-4ed0-ad53-cb24dada3bdc {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:01 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:18:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:01 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc 1073741824 Jul 03 01:18:01 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:02 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc 1073741824" returned: 0 in 1.089s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:02 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc Jul 03 01:18:02 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "cinder-fa03722b-ec6a-44a7-9bb6-2d91266a568f-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "cinder-fa03722b-ec6a-44a7-9bb6-2d91266a568f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "cinder-quobyte-fa03722b-ec6a-44a7-9bb6-2d91266a568f" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "cinder-quobyte-fa03722b-ec6a-44a7-9bb6-2d91266a568f" acquired by "delete_volume" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:03 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75518d9-4e8e-4793-85dd-6a458f9cab49]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:03 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f Jul 03 01:18:03 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:03 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc" returned: 0 in 1.237s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:03 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.401s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f366a8-a69b-41e6-b54f-d2ccfbbd27e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c212da-a290-4ed0-ad53-cb24dada3bdc', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0881d006-d7dc-4902-a7e4-db47229bb5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:03 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Volume volume-46c212da-a290-4ed0-ad53-cb24dada3bdc (46c212da-a290-4ed0-ad53-cb24dada3bdc): created successfully Jul 03 01:18:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0881d006-d7dc-4902-a7e4-db47229bb5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Flow 'volume_create_manager' (755ecc2b-fd96-4514-9815-ab9e5342f726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:04 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4c7a5e9f-8898-4513-8217-9d6e647ad6bd tempest-AttachVolumeNegativeTest-509862070 None] Created volume successfully. Jul 03 01:18:04 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f" returned: 0 in 1.300s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:04 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f Jul 03 01:18:04 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:05 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fa03722b-ec6a-44a7-9bb6-2d91266a568f" returned: 0 in 0.880s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "cinder-quobyte-fa03722b-ec6a-44a7-9bb6-2d91266a568f" released by "delete_volume" :: held 2.271s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:05 devstack cinder-volume[86357]: WARNING cinder.quota [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1407883092-1157094531 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1407883092-1157094531, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:18:05 devstack cinder-volume[86357]: WARNING cinder.quota [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1407883092-1157094531 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1407883092-1157094531, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:18:05 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Created reservations ['82c95116-8c0b-4e6f-a699-4e428bd3c389', '830b6710-0dc3-4e48-922f-d4edd281bb27', 'fe32adbc-d3d9-42eb-a6b5-e65c589d1293', 'a5a66929-203a-4f21-8a04-8d9cd87f1fd9'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:05 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:18:05 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:06 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.842s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:06 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:06 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Deleted volume successfully. Jul 03 01:18:06 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37484f2c-866b-4cfd-a1f9-7d0e1d3303f1 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "cinder-fa03722b-ec6a-44a7-9bb6-2d91266a568f-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-4188857d-0c38-4f76-96b9-7dc830f3912f req-fba05b61-5853-48f4-921b-697bb633a79a tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-4188857d-0c38-4f76-96b9-7dc830f3912f req-fba05b61-5853-48f4-921b-697bb633a79a tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:08 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48242aa-ccc2-4a09-bf9d-ca2f592aec40]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-4188857d-0c38-4f76-96b9-7dc830f3912f req-fba05b61-5853-48f4-921b-697bb633a79a tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:08 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc Jul 03 01:18:08 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:09 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-4188857d-0c38-4f76-96b9-7dc830f3912f req-fba05b61-5853-48f4-921b-697bb633a79a tempest-AttachVolumeNegativeTest-509862070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc" returned: 0 in 0.934s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-4188857d-0c38-4f76-96b9-7dc830f3912f req-fba05b61-5853-48f4-921b-697bb633a79a tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.961s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-4188857d-0c38-4f76-96b9-7dc830f3912f req-fba05b61-5853-48f4-921b-697bb633a79a tempest-AttachVolumeNegativeTest-509862070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-46c212da-a290-4ed0-ad53-cb24dada3bdc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae8d3f35-33a4-450c-be80-cbd0d6a68a29', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:18:09 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-4188857d-0c38-4f76-96b9-7dc830f3912f req-fba05b61-5853-48f4-921b-697bb633a79a tempest-AttachVolumeNegativeTest-509862070 None] attachment_update completed successfully. Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Flow 'volume_create_manager' (cec79c04-272d-45be-8b84-a0a52b623313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e86f639-3012-441b-9102-dbdecc135635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e86f639-3012-441b-9102-dbdecc135635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-268478183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf084be9-9d38-4c32-b838-8f64affc77d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bff4d49a7834c55bd658f31d1c097bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:11Z,use_quota=True,user_id='27b7ef4ec26c41d5b602eeb9f4a8a2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56125eb-5d1c-4cfa-b4a4-68d0f1edcce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56125eb-5d1c-4cfa-b4a4-68d0f1edcce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea602957-a86b-4881-bf73-46249118321c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea602957-a86b-4881-bf73-46249118321c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf084be9-9d38-4c32-b838-8f64affc77d3', 'volume_name': 'volume-bf084be9-9d38-4c32-b838-8f64affc77d3', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb36201-af14-4a92-ab27-0a1f08a8ae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb36201-af14-4a92-ab27-0a1f08a8ae06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a323bd-7496-4f54-9866-7dfed64b1096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:11 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Volume bf084be9-9d38-4c32-b838-8f64affc77d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf084be9-9d38-4c32-b838-8f64affc77d3', 'volume_size': 1} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-268478183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf084be9-9d38-4c32-b838-8f64affc77d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bff4d49a7834c55bd658f31d1c097bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:11Z,use_quota=True,user_id='27b7ef4ec26c41d5b602eeb9f4a8a2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Creating volume bf084be9-9d38-4c32-b838-8f64affc77d3 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:11 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:11 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3 1073741824 Jul 03 01:18:11 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Flow 'volume_create_manager' (1d36ce2e-08d0-4768-9206-b4700f005d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498986e9-6b70-4964-8e1f-eda9e0ecd996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498986e9-6b70-4964-8e1f-eda9e0ecd996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2131531061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f53c77-5ad4-40ef-b192-c40c52dbcd6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bff4d49a7834c55bd658f31d1c097bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:12Z,use_quota=True,user_id='27b7ef4ec26c41d5b602eeb9f4a8a2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e807a9-8f6a-4085-93e8-433cdc9ca3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e807a9-8f6a-4085-93e8-433cdc9ca3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049ac887-f01c-4073-8a71-089c9a9c5b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049ac887-f01c-4073-8a71-089c9a9c5b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f53c77-5ad4-40ef-b192-c40c52dbcd6d', 'volume_name': 'volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d19c50-2dca-4061-b069-b27c7da0daad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d19c50-2dca-4061-b069-b27c7da0daad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5299c6ba-cab0-4bba-8a0b-24d1dbc813ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:11 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Volume 52f53c77-5ad4-40ef-b192-c40c52dbcd6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d', 'volume_size': 1} Jul 03 01:18:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:12 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3 1073741824" returned: 0 in 1.390s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:12 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3 Jul 03 01:18:12 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:13 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3" returned: 0 in 0.866s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] <== create_volume: return (2340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.346s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2131531061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f53c77-5ad4-40ef-b192-c40c52dbcd6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bff4d49a7834c55bd658f31d1c097bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:12Z,use_quota=True,user_id='27b7ef4ec26c41d5b602eeb9f4a8a2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Creating volume 52f53c77-5ad4-40ef-b192-c40c52dbcd6d {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:13 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:13 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d 1073741824 Jul 03 01:18:13 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a323bd-7496-4f54-9866-7dfed64b1096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf084be9-9d38-4c32-b838-8f64affc77d3', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e864cc-10c4-402e-b945-3ebb7bb6f44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:13 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Volume volume-bf084be9-9d38-4c32-b838-8f64affc77d3 (bf084be9-9d38-4c32-b838-8f64affc77d3): created successfully Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e864cc-10c4-402e-b945-3ebb7bb6f44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Flow 'volume_create_manager' (cec79c04-272d-45be-8b84-a0a52b623313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3a500756-fceb-4cc6-b43b-c582ba545451 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Created volume successfully. Jul 03 01:18:15 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d 1073741824" returned: 0 in 1.552s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:15 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d Jul 03 01:18:15 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:15 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-af33c8d1-a7c9-455a-b422-7d068fc4d2d2 req-f0efbf49-e393-44ad-a038-01caa048f109 tempest-AttachVolumeNegativeTest-509862070 None] Terminate volume connection completed successfully. Jul 03 01:18:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-af33c8d1-a7c9-455a-b422-7d068fc4d2d2 req-f0efbf49-e393-44ad-a038-01caa048f109 tempest-AttachVolumeNegativeTest-509862070 None] Deleting attachment ae8d3f35-33a4-450c-be80-cbd0d6a68a29. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:18:16 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d" returned: 0 in 1.070s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] <== create_volume: return (2682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.689s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5299c6ba-cab0-4bba-8a0b-24d1dbc813ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd1a06e-00db-41df-ac50-114bbef78e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:16 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Volume volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d (52f53c77-5ad4-40ef-b192-c40c52dbcd6d): created successfully Jul 03 01:18:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd1a06e-00db-41df-ac50-114bbef78e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Flow 'volume_create_manager' (1d36ce2e-08d0-4768-9206-b4700f005d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-043cc611-01ce-4f70-8d3b-2ad4b6b766d5 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Created volume successfully. Jul 03 01:18:19 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-bcd3b43b-2885-4729-8837-e027f4ac8f23 req-6d4931d5-0613-46b5-b783-58381dfbfa1c tempest-TestInstancesWithCinderVolumes-14527428 None] Terminate volume connection completed successfully. Jul 03 01:18:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-bcd3b43b-2885-4729-8837-e027f4ac8f23 req-6d4931d5-0613-46b5-b783-58381dfbfa1c tempest-TestInstancesWithCinderVolumes-14527428 None] Deleting attachment bf5aff79-755b-4fe3-96bf-7335c5e9e899. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:18:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "cinder-8be107d4-6d33-4c2c-a08e-331c5686795d-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "cinder-8be107d4-6d33-4c2c-a08e-331c5686795d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "cinder-quobyte-8be107d4-6d33-4c2c-a08e-331c5686795d" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "cinder-quobyte-8be107d4-6d33-4c2c-a08e-331c5686795d" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:23 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed46ff-93d5-48cb-a05d-274c02171602]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:23 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d Jul 03 01:18:23 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:23 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d" returned: 0 in 0.817s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:24 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d Jul 03 01:18:24 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:24 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d" returned: 1 in 0.886s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:18:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:24 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d Jul 03 01:18:24 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:25 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8be107d4-6d33-4c2c-a08e-331c5686795d" returned: 0 in 0.856s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "cinder-quobyte-8be107d4-6d33-4c2c-a08e-331c5686795d" released by "delete_volume" :: held 2.640s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:25 devstack cinder-volume[86357]: WARNING cinder.quota [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1495000845-595574222 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1495000845-595574222, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:18:25 devstack cinder-volume[86357]: WARNING cinder.quota [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1495000845-595574222 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1495000845-595574222, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:18:25 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Created reservations ['5c022071-5e58-44e0-b690-eae52d488ff6', 'bb2b5ca2-2492-4e79-8ab2-daa40fe929a3', '3de55e0b-5d90-47c5-a301-bb42b5f1ab15', 'bbff9fc2-4b50-44ea-9d93-c1682a86467f'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:25 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:18:25 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:26 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.965s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:26 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:26 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Deleted volume successfully. Jul 03 01:18:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b6142e42-ab0b-4e0d-8040-61054cf62971 tempest-TestInstancesWithCinderVolumes-14527428 None] Lock "cinder-8be107d4-6d33-4c2c-a08e-331c5686795d-delete_volume" released by "delete_volume" :: held 3.918s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:18:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:27 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:18:27 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:28 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.850s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:18:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:18:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:18:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "cinder-46c212da-a290-4ed0-ad53-cb24dada3bdc-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Lock "cinder-46c212da-a290-4ed0-ad53-cb24dada3bdc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "cinder-quobyte-46c212da-a290-4ed0-ad53-cb24dada3bdc" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Lock "cinder-quobyte-46c212da-a290-4ed0-ad53-cb24dada3bdc" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:32 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[5511c005-87d9-4f52-8cc6-c2501a24c5f0]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:32 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc Jul 03 01:18:32 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:33 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc" returned: 0 in 0.955s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:33 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc Jul 03 01:18:33 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:33 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-46c212da-a290-4ed0-ad53-cb24dada3bdc" returned: 0 in 0.751s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Lock "cinder-quobyte-46c212da-a290-4ed0-ad53-cb24dada3bdc" released by "delete_volume" :: held 1.785s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Created reservations ['00007751-f30c-4e8c-9259-f552bd9de9e2', 'ef7bcf53-78a4-4973-b2d5-a6e4670d0f9f', 'b32347a6-647a-4805-b84e-a408c724b7fc', '3fc0ec82-6a21-4300-8a12-9e2c22bd4847'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:34 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:18:34 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "cinder-d24a0c47-258e-405e-8f4c-192c9a6ef41b-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Lock "cinder-d24a0c47-258e-405e-8f4c-192c9a6ef41b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "cinder-quobyte-d24a0c47-258e-405e-8f4c-192c9a6ef41b" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Lock "cinder-quobyte-d24a0c47-258e-405e-8f4c-192c9a6ef41b" acquired by "delete_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9468528-b946-4c6f-804a-1caa1247e364]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:34 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b Jul 03 01:18:34 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:34 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.772s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:34 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Deleted volume successfully. Jul 03 01:18:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2dbac6fd-c5e2-411b-9b46-982617b2a761 tempest-AttachVolumeNegativeTest-509862070 None] Lock "cinder-46c212da-a290-4ed0-ad53-cb24dada3bdc-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:36 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b" returned: 0 in 1.640s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:36 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b Jul 03 01:18:36 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:37 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d24a0c47-258e-405e-8f4c-192c9a6ef41b" returned: 0 in 1.452s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Lock "cinder-quobyte-d24a0c47-258e-405e-8f4c-192c9a6ef41b" released by "delete_volume" :: held 3.167s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:37 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Created reservations ['c6fd6083-e074-4274-a73e-69ab51ec88af', '18a3a322-50a5-471f-8860-66b95dc3e630', '2fb35c13-d4b1-472e-b9ad-828e92827174', '02f400eb-5905-4b9b-b13c-7330cf66e4fa'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:38 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:18:38 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:39 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.130s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:39 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:39 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Deleted volume successfully. Jul 03 01:18:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e8e2f711-da96-4856-a048-7dbbec3ab984 tempest-AttachVolumeNegativeTest-509862070 None] Lock "cinder-d24a0c47-258e-405e-8f4c-192c9a6ef41b-delete_volume" released by "delete_volume" :: held 4.790s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "cinder-fe8bda29-e01e-488e-8aaf-614029ec6468-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Lock "cinder-fe8bda29-e01e-488e-8aaf-614029ec6468-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "cinder-quobyte-fe8bda29-e01e-488e-8aaf-614029ec6468" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Lock "cinder-quobyte-fe8bda29-e01e-488e-8aaf-614029ec6468" acquired by "delete_volume" :: waited 0.042s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:40 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4a78a4-d894-4e9d-a45d-48912ae10791]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:40 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468 Jul 03 01:18:40 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:42 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468" returned: 0 in 1.697s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:42 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468 Jul 03 01:18:42 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:43 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fe8bda29-e01e-488e-8aaf-614029ec6468" returned: 0 in 1.328s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Lock "cinder-quobyte-fe8bda29-e01e-488e-8aaf-614029ec6468" released by "delete_volume" :: held 3.135s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:43 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Created reservations ['d4ff3517-9a0c-48ce-a0e3-1dfd94a15678', 'd0c4346e-49bc-4174-97a3-76fedb49f733', 'e287e266-8f3e-413b-a977-7a418d734b13', '25af0d31-04bc-4853-8148-a4348c13b142'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:44 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:18:44 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:45 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.746s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:45 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:45 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Deleted volume successfully. Jul 03 01:18:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8f951dc2-54fe-4f1d-9c0f-d356ee8b815e tempest-AttachVolumeNegativeTest-509862070 None] Lock "cinder-fe8bda29-e01e-488e-8aaf-614029ec6468-delete_volume" released by "delete_volume" :: held 5.458s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:52 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=44,cinder:INSERT=11,cinder:UPDATE=60,cinder:DELETE=6 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:18:52 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=49,cinder:UPDATE=59,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:18:52 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Flow 'volume_create_manager' (27678397-a27f-40e5-a178-ba06ac532a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0885bae4-962e-4357-8d7c-97bd5d4ab9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0885bae4-962e-4357-8d7c-97bd5d4ab9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf152e5-1157-4048-a303-a03a9d15d6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6eb8b3406b746a98ca4914f447fb7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:52Z,use_quota=True,user_id='8772bd1de2b54ec4b68d80d69cede80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(355a6feb-38f7-4947-ac80-53894712e8dd),volume_type_id=355a6feb-38f7-4947-ac80-53894712e8dd)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9425bc52-17c3-469e-bdde-31b0764834e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9425bc52-17c3-469e-bdde-31b0764834e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306232cc-040c-4094-a3f6-3898531b3462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:52 devstack cinder-volume[86357]: DEBUG cinder.image.glance [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Creating Keystone auth plugin from conf {{(pid=86357) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:18:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306232cc-040c-4094-a3f6-3898531b3462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aaf152e5-1157-4048-a303-a03a9d15d6f4', 'volume_name': 'volume-aaf152e5-1157-4048-a303-a03a9d15d6f4', 'volume_size': 1, 'image_id': '216cb0ce-9b52-48a4-85d6-a83ffcb21aa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/216cb0ce-9b52-48a4-85d6-a83ffcb21aa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1206ff55831fdaf477214da322f931d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6eb8b3406b746a98ca4914f447fb7b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '305dd4838f513baf97a3b11454a77d13cf3553ec9776f376ef950c2f780d7ffaba769c551a6c21db762857a7780b236e7be095b64b74af1d425722c83653424b', 'id': '216cb0ce-9b52-48a4-85d6-a83ffcb21aa4', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/216cb0ce-9b52-48a4-85d6-a83ffcb21aa4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c55c76-f744-469a-8686-a252b6446512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c55c76-f744-469a-8686-a252b6446512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da93ba3-8753-4cd3-a067-c4ff2faeb9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:53 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Volume aaf152e5-1157-4048-a303-a03a9d15d6f4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aaf152e5-1157-4048-a303-a03a9d15d6f4', 'volume_size': 1, 'image_id': '216cb0ce-9b52-48a4-85d6-a83ffcb21aa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/216cb0ce-9b52-48a4-85d6-a83ffcb21aa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1206ff55831fdaf477214da322f931d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6eb8b3406b746a98ca4914f447fb7b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '305dd4838f513baf97a3b11454a77d13cf3553ec9776f376ef950c2f780d7ffaba769c551a6c21db762857a7780b236e7be095b64b74af1d425722c83653424b', 'id': '216cb0ce-9b52-48a4-85d6-a83ffcb21aa4', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/216cb0ce-9b52-48a4-85d6-a83ffcb21aa4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 01:18:53 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Trying to clone aaf152e5-1157-4048-a303-a03a9d15d6f4 from image 216cb0ce-9b52-48a4-85d6-a83ffcb21aa4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/216cb0ce-9b52-48a4-85d6-a83ffcb21aa4', 'metadata': {}}]). {{(pid=86357) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:18:53 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:18:53 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Image download 0.00 MB at 0.00 MB/s Jul 03 01:18:53 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[804b98de-56d7-41bf-be90-22ff151d76e8]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:53 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD Jul 03 01:18:53 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:54 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD" returned: 0 in 0.800s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:54 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD Jul 03 01:18:54 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:54 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD" returned: 1 in 0.733s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:18:54 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Temporary image 216cb0ce-9b52-48a4-85d6-a83ffcb21aa4 is fetched for user 8772bd1de2b54ec4b68d80d69cede80f. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:18:54 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[11421995-3621-46ea-a30e-f970b6f61dd3]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:54 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD Jul 03 01:18:54 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:54 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Flow 'volume_create_manager' (40df4905-b9dd-44bf-be7f-5f867fa54886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c21643-8639-4731-a273-993fa9fb868b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c21643-8639-4731-a273-993fa9fb868b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-911413465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67cb56f-5062-4675-8647-a0b8c8e53bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a25e96dd591e43d8bec3c1518d96621d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:55Z,use_quota=True,user_id='8428c6ae2680498e9f3d0b0a865eee99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2e5665-c37d-41b8-af93-dbeefd4e5971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2e5665-c37d-41b8-af93-dbeefd4e5971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e25423-38ed-4afb-bcbc-7a21dbfb4ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e25423-38ed-4afb-bcbc-7a21dbfb4ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f67cb56f-5062-4675-8647-a0b8c8e53bde', 'volume_name': 'volume-f67cb56f-5062-4675-8647-a0b8c8e53bde', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac01c09-586a-4c27-91fc-087f89eab599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac01c09-586a-4c27-91fc-087f89eab599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a9f09d-f8d3-4797-b248-c3e4ce867854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:55 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Volume f67cb56f-5062-4675-8647-a0b8c8e53bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f67cb56f-5062-4675-8647-a0b8c8e53bde', 'volume_size': 1} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-911413465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67cb56f-5062-4675-8647-a0b8c8e53bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a25e96dd591e43d8bec3c1518d96621d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:55Z,use_quota=True,user_id='8428c6ae2680498e9f3d0b0a865eee99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Creating volume f67cb56f-5062-4675-8647-a0b8c8e53bde {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:55 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:55 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde 1073741824 Jul 03 01:18:55 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:55 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD" returned: 0 in 0.752s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:55 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD Jul 03 01:18:55 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:55 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde 1073741824" returned: 0 in 0.824s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:55 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde Jul 03 01:18:55 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:56 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD" returned: 1 in 0.726s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:56 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde" returned: 0 in 0.620s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.254s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf152e5-1157-4048-a303-a03a9d15d6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6eb8b3406b746a98ca4914f447fb7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:52Z,use_quota=True,user_id='8772bd1de2b54ec4b68d80d69cede80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(355a6feb-38f7-4947-ac80-53894712e8dd),volume_type_id=355a6feb-38f7-4947-ac80-53894712e8dd)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Creating volume aaf152e5-1157-4048-a303-a03a9d15d6f4 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:56 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:56 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 1073741824 Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a9f09d-f8d3-4797-b248-c3e4ce867854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f67cb56f-5062-4675-8647-a0b8c8e53bde', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:56 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79377f64-9d2d-48eb-9c04-7fd5f585f814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:56 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Volume volume-f67cb56f-5062-4675-8647-a0b8c8e53bde (f67cb56f-5062-4675-8647-a0b8c8e53bde): created successfully Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79377f64-9d2d-48eb-9c04-7fd5f585f814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Flow 'volume_create_manager' (40df4905-b9dd-44bf-be7f-5f867fa54886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:56 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-c2472272-f6fd-4617-a313-361cb939a802 req-21f90f4d-3f14-40e8-a55f-3db818eeb9e5 tempest-VolumesSnapshotsTestJSON-273620147 None] Created volume successfully. Jul 03 01:18:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:57 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 1073741824" returned: 0 in 0.904s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:57 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 Jul 03 01:18:57 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:58 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4" returned: 0 in 0.679s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.838s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] Creating offline snapshot f240d50e-e04f-4aba-bec0-ac1b3eb03842 of volume f67cb56f-5062-4675-8647-a0b8c8e53bde {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:18:58 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Attempting download of 216cb0ce-9b52-48a4-85d6-a83ffcb21aa4 ((None, [{'url': 'file:///opt/stack/data/glance/images/216cb0ce-9b52-48a4-85d6-a83ffcb21aa4', 'metadata': {}}])) to volume aaf152e5-1157-4048-a303-a03a9d15d6f4. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:18:58 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[823217c2-8173-4255-9c4d-e999017ba3e2]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:58 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3a3908-13bb-4255-b413-16062e152166]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_hna8yqak {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:58 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde Jul 03 01:18:58 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:58 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_hna8yqak Jul 03 01:18:58 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:59 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_hna8yqak" returned: 0 in 0.833s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_hna8yqak {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:59 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde" returned: 0 in 0.891s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:59 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 1G Jul 03 01:18:59 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:59 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_hna8yqak Jul 03 01:18:59 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:59 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_hna8yqak" returned: 1 in 0.817s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_hna8yqak' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:18:59 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d3bcc0-578f-4e6e-a6e1-20a0d736099e]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:00 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD Jul 03 01:19:00 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:00 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 1G" returned: 0 in 0.993s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f67cb56f-5062-4675-8647-a0b8c8e53bde -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:00 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f67cb56f-5062-4675-8647-a0b8c8e53bde -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 Jul 03 01:19:00 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:00 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD" returned: 0 in 0.791s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:00 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD Jul 03 01:19:00 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:01 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f67cb56f-5062-4675-8647-a0b8c8e53bde -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842" returned: 0 in 0.895s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:01 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 is being set with open permissions: ugo+rw Jul 03 01:19:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:01 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 Jul 03 01:19:01 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:01 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD" returned: 1 in 0.934s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:19:01 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] 216cb0ce-9b52-48a4-85d6-a83ffcb21aa4 was raw, converting to raw {{(pid=86357) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:19:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:01 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842" returned: 0 in 0.662s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:01 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 Jul 03 01:19:01 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:01 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.info Jul 03 01:19:01 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:02 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4" returned: 0 in 0.703s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:02 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_216cb0ce-9b52-48a4-85d6-a83ffcb21aa4_rky8iq28devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:19:02 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 01:19:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:02 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 1G Jul 03 01:19:02 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:02 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.info" returned: 0 in 0.728s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:02 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.info is being set with open permissions: ugo+rw Jul 03 01:19:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:02 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.info Jul 03 01:19:02 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:03 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 1G" returned: 0 in 0.815s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:03 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.info" returned: 0 in 0.753s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.029s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:03 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a6a9a2-54aa-4f00-9b15-4017f81dcc83]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:03 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-d692d272-5171-4e79-92e2-be4231c1e9f9 req-5e47df1b-5890-436e-ae9a-5ade143f6d42 tempest-VolumesSnapshotsTestJSON-273620147 None] Create snapshot completed successfully Jul 03 01:19:03 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 Jul 03 01:19:03 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:04 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4" returned: 0 in 0.755s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:04 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 Jul 03 01:19:04 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Acquiring lock "cinder-f240d50e-e04f-4aba-bec0-ac1b3eb03842-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "cinder-f240d50e-e04f-4aba-bec0-ac1b3eb03842-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Acquiring lock "cinder-quobyte-f67cb56f-5062-4675-8647-a0b8c8e53bde" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "cinder-quobyte-f67cb56f-5062-4675-8647-a0b8c8e53bde" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Acquiring lock "cinder-quobyte-f240d50e-e04f-4aba-bec0-ac1b3eb03842" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "cinder-quobyte-f240d50e-e04f-4aba-bec0-ac1b3eb03842" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Deleting offline snapshot f240d50e-e04f-4aba-bec0-ac1b3eb03842 of volume f67cb56f-5062-4675-8647-a0b8c8e53bde {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] snapshot_file for this snap is: volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a1a8d0-1650-41c3-a962-f76471662441]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:04 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 Jul 03 01:19:04 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:04 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4" returned: 1 in 0.778s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Downloaded image 216cb0ce-9b52-48a4-85d6-a83ffcb21aa4 ((None, [{'url': 'file:///opt/stack/data/glance/images/216cb0ce-9b52-48a4-85d6-a83ffcb21aa4', 'metadata': {}}])) to volume aaf152e5-1157-4048-a303-a03a9d15d6f4 successfully. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Temporary image 216cb0ce-9b52-48a4-85d6-a83ffcb21aa4 for user 8772bd1de2b54ec4b68d80d69cede80f is deleted. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Marking volume aaf152e5-1157-4048-a303-a03a9d15d6f4 as bootable. {{(pid=86357) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Copying metadata from image 216cb0ce-9b52-48a4-85d6-a83ffcb21aa4 to aaf152e5-1157-4048-a303-a03a9d15d6f4. {{(pid=86357) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Creating volume glance metadata for volume aaf152e5-1157-4048-a303-a03a9d15d6f4 backed by image 216cb0ce-9b52-48a4-85d6-a83ffcb21aa4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '216cb0ce-9b52-48a4-85d6-a83ffcb21aa4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a1206ff55831fdaf477214da322f931d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86357) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da93ba3-8753-4cd3-a067-c4ff2faeb9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaf152e5-1157-4048-a303-a03a9d15d6f4', 'volume_size': 1, 'image_id': '216cb0ce-9b52-48a4-85d6-a83ffcb21aa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/216cb0ce-9b52-48a4-85d6-a83ffcb21aa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1206ff55831fdaf477214da322f931d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6eb8b3406b746a98ca4914f447fb7b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '305dd4838f513baf97a3b11454a77d13cf3553ec9776f376ef950c2f780d7ffaba769c551a6c21db762857a7780b236e7be095b64b74af1d425722c83653424b', 'id': '216cb0ce-9b52-48a4-85d6-a83ffcb21aa4', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/216cb0ce-9b52-48a4-85d6-a83ffcb21aa4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e865e8c1-aab5-4dae-8269-ac61eaf8e52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:04 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Volume volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 (aaf152e5-1157-4048-a303-a03a9d15d6f4): created successfully Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e865e8c1-aab5-4dae-8269-ac61eaf8e52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Flow 'volume_create_manager' (27678397-a27f-40e5-a178-ba06ac532a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:04 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-195ee0ae-0b36-4f27-a063-a83fec5471fd tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Created volume successfully. Jul 03 01:19:05 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842" returned: 0 in 0.830s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f67cb56f-5062-4675-8647-a0b8c8e53bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:19:05 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce042811-c441-4e24-b5c8-b4afa4d4d35a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:05 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde Jul 03 01:19:05 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Acquiring lock "cinder-aaf152e5-1157-4048-a303-a03a9d15d6f4-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Lock "cinder-aaf152e5-1157-4048-a303-a03a9d15d6f4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Acquiring lock "cinder-quobyte-aaf152e5-1157-4048-a303-a03a9d15d6f4" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Lock "cinder-quobyte-aaf152e5-1157-4048-a303-a03a9d15d6f4" acquired by "delete_volume" :: waited 0.033s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:05 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7516cd-04d5-4eca-a6af-52686a34e268]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:05 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 Jul 03 01:19:05 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:05 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde" returned: 0 in 0.899s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:06 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 Jul 03 01:19:06 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Flow 'volume_create_manager' (f5c4363c-771c-4e58-9bf4-59992bc05a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde1eaeb-cfbb-496c-b590-1f0dd435aecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:06 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde1eaeb-cfbb-496c-b590-1f0dd435aecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-55426847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29517d9-13d0-46a3-8898-3d3b3bbf8c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b458a8c9cb4fc4ab48e893040916e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:06Z,use_quota=True,user_id='f408cd4c706944419af58e7885bad0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9668b2-4b61-4797-b824-2c3a03023346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9668b2-4b61-4797-b824-2c3a03023346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cd37f1-3b0d-4254-9dde-42b654ba61b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cd37f1-3b0d-4254-9dde-42b654ba61b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e29517d9-13d0-46a3-8898-3d3b3bbf8c44', 'volume_name': 'volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67ab8e7-aebe-49b7-9b44-0b521b113bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67ab8e7-aebe-49b7-9b44-0b521b113bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fddc15-3e13-4734-ab48-0ba61257f67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:06 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Volume e29517d9-13d0-46a3-8898-3d3b3bbf8c44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44', 'volume_size': 1} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-55426847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29517d9-13d0-46a3-8898-3d3b3bbf8c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b458a8c9cb4fc4ab48e893040916e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:06Z,use_quota=True,user_id='f408cd4c706944419af58e7885bad0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Creating volume e29517d9-13d0-46a3-8898-3d3b3bbf8c44 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:06 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4" returned: 0 in 1.020s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:06 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44 1073741824 Jul 03 01:19:06 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-f00a4046-3205-4517-954b-d3b970d3a327 req-20221a98-ba62-4614-a0ea-f37b4d0808fd tempest-TestServerVolumeAttachmentScenario-1870684654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:06 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 Jul 03 01:19:06 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:06 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842" returned: 0 in 0.872s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:06 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842 Jul 03 01:19:06 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:07 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:07 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4" returned: 1 in 0.862s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:19:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44 1073741824" returned: 0 in 0.893s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:07 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4 Jul 03 01:19:07 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:07 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44 Jul 03 01:19:07 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:07 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde.f240d50e-e04f-4aba-bec0-ac1b3eb03842" returned: 0 in 0.734s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "cinder-quobyte-f240d50e-e04f-4aba-bec0-ac1b3eb03842" released by "_delete_snapshot" :: held 3.451s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "cinder-quobyte-f67cb56f-5062-4675-8647-a0b8c8e53bde" released by "delete_snapshot" :: held 3.476s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:07 devstack cinder-volume[86357]: DEBUG cinder.quota [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Created reservations ['083cf2c7-102e-47df-9c52-b05d46213292', '674d9b35-291e-45c8-8323-e5c147a30d0c', '2eb897a0-1e1c-4764-818f-1fcc52a9fc62', '5f5412a6-dd3b-462e-937f-f6d0dbbf2003'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:07 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Delete snapshot completed successfully. Jul 03 01:19:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-359a6250-ad5b-429c-b5af-fefdfcdb32ba req-5262d8d8-66c9-44a3-aa30-079fa78710f4 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "cinder-f240d50e-e04f-4aba-bec0-ac1b3eb03842-delete_snapshot" released by "delete_snapshot" :: held 3.625s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:08 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:08 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-aaf152e5-1157-4048-a303-a03a9d15d6f4" returned: 0 in 0.728s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44" returned: 0 in 0.687s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Lock "cinder-quobyte-aaf152e5-1157-4048-a303-a03a9d15d6f4" released by "delete_volume" :: held 2.707s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-f00a4046-3205-4517-954b-d3b970d3a327 req-20221a98-ba62-4614-a0ea-f37b4d0808fd tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.593s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[03747805-07ab-4b1a-ab79-2f486844844f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-f00a4046-3205-4517-954b-d3b970d3a327 req-20221a98-ba62-4614-a0ea-f37b4d0808fd tempest-TestServerVolumeAttachmentScenario-1870684654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fddc15-3e13-4734-ab48-0ba61257f67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297d524b-39a0-44a3-81a8-1f25d8862536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:08 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Volume volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44 (e29517d9-13d0-46a3-8898-3d3b3bbf8c44): created successfully Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297d524b-39a0-44a3-81a8-1f25d8862536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Flow 'volume_create_manager' (f5c4363c-771c-4e58-9bf4-59992bc05a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:08 devstack cinder-volume[86357]: WARNING cinder.quota [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:19:08 devstack cinder-volume[86357]: WARNING cinder.quota [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:19:08 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8fd96b33-e83d-4d37-988e-504be01eac98 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Created volume successfully. Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Created reservations ['89e32233-f924-404f-b88c-230bdf06d049', 'b85f6a75-71c7-44c1-a3d6-0e9223de68aa', 'dc2b5459-6755-4037-8d21-f9b93e34a7e3', '2a0767fc-bdc9-4c71-9dd0-c278cf4b59fa'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:08 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3 Jul 03 01:19:08 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:08 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:19:08 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Acquiring lock "cinder-f67cb56f-5062-4675-8647-a0b8c8e53bde-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "cinder-f67cb56f-5062-4675-8647-a0b8c8e53bde-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Acquiring lock "cinder-quobyte-f67cb56f-5062-4675-8647-a0b8c8e53bde" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "cinder-quobyte-f67cb56f-5062-4675-8647-a0b8c8e53bde" acquired by "delete_volume" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f3ba34-4d60-4bcf-b52a-1fcaa24cbd46]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:09 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-f00a4046-3205-4517-954b-d3b970d3a327 req-20221a98-ba62-4614-a0ea-f37b4d0808fd tempest-TestServerVolumeAttachmentScenario-1870684654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3" returned: 0 in 0.891s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-f00a4046-3205-4517-954b-d3b970d3a327 req-20221a98-ba62-4614-a0ea-f37b4d0808fd tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.910s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-f00a4046-3205-4517-954b-d3b970d3a327 req-20221a98-ba62-4614-a0ea-f37b4d0808fd tempest-TestServerVolumeAttachmentScenario-1870684654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-bf084be9-9d38-4c32-b838-8f64affc77d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d4fe394-39b1-44ce-ac6f-362a06c84551', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:19:09 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde Jul 03 01:19:09 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:09 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.817s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:09 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:09 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Deleted volume successfully. Jul 03 01:19:09 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1b51b6f3-5223-4c00-8aa7-0ca675ae88cc tempest-VolumeAndVolumeTypeFromImageTest-1055638896 None] Lock "cinder-aaf152e5-1157-4048-a303-a03a9d15d6f4-delete_volume" released by "delete_volume" :: held 3.837s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:09 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-f00a4046-3205-4517-954b-d3b970d3a327 req-20221a98-ba62-4614-a0ea-f37b4d0808fd tempest-TestServerVolumeAttachmentScenario-1870684654 None] attachment_update completed successfully. Jul 03 01:19:09 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde" returned: 0 in 0.889s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:09 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde Jul 03 01:19:09 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:10 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f67cb56f-5062-4675-8647-a0b8c8e53bde" returned: 0 in 0.848s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "cinder-quobyte-f67cb56f-5062-4675-8647-a0b8c8e53bde" released by "delete_volume" :: held 1.811s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:10 devstack cinder-volume[86357]: DEBUG cinder.quota [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Created reservations ['0e93eae2-7165-4df4-ada8-8f2a79d31118', '30797b2f-99c4-4bb0-ac42-dd09412433cb', 'fb7204f0-c584-437f-9ea2-dab2fa5fc7ee', 'cb2a32d0-6937-4940-ba0a-b7728edd1fde'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:10 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:19:10 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-d852e4cf-ada3-4225-b6c6-2b03670fb783 req-7464c335-0fb7-4354-8071-e72d875ade9c tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-d852e4cf-ada3-4225-b6c6-2b03670fb783 req-7464c335-0fb7-4354-8071-e72d875ade9c tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:11 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d131997-d229-4427-a54b-2359dc298c17]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d852e4cf-ada3-4225-b6c6-2b03670fb783 req-7464c335-0fb7-4354-8071-e72d875ade9c tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:11 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.902s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:11 devstack cinder-volume[86357]: DEBUG cinder.manager [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:11 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Deleted volume successfully. Jul 03 01:19:11 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-d5866e1d-fa91-4051-8c15-5870d7c1b66d req-ba22034c-5eac-4a3b-8093-df692f4e1241 tempest-VolumesSnapshotsTestJSON-273620147 None] Lock "cinder-f67cb56f-5062-4675-8647-a0b8c8e53bde-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:11 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44 Jul 03 01:19:11 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:12 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-d852e4cf-ada3-4225-b6c6-2b03670fb783 req-7464c335-0fb7-4354-8071-e72d875ade9c tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44" returned: 0 in 1.045s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-d852e4cf-ada3-4225-b6c6-2b03670fb783 req-7464c335-0fb7-4354-8071-e72d875ade9c tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.065s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-d852e4cf-ada3-4225-b6c6-2b03670fb783 req-7464c335-0fb7-4354-8071-e72d875ade9c tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fa079bf-1adb-4eff-af33-8df0b25bd04e', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:19:12 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-d852e4cf-ada3-4225-b6c6-2b03670fb783 req-7464c335-0fb7-4354-8071-e72d875ade9c tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] attachment_update completed successfully. Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Flow 'volume_create_manager' (6bbd1cb6-0b57-4c15-9cc7-087bd15c1b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a47bf42-84bc-4238-a8af-a33fe70daa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a47bf42-84bc-4238-a8af-a33fe70daa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1715265685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8799ddbc-f439-49cc-9660-58a1c7d14a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f1346959774941adb0fc5a78710ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:14Z,use_quota=True,user_id='07224ed51dcb4c85b9c9a588339cba85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef55dac4-c46b-43e7-a86f-f48642d5d1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef55dac4-c46b-43e7-a86f-f48642d5d1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0e2b2a-4a6d-484b-b8ba-8903058a4576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0e2b2a-4a6d-484b-b8ba-8903058a4576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8799ddbc-f439-49cc-9660-58a1c7d14a09', 'volume_name': 'volume-8799ddbc-f439-49cc-9660-58a1c7d14a09', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89402ce8-68d6-4ca8-8752-35c25d1a15ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89402ce8-68d6-4ca8-8752-35c25d1a15ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cf72ac-586b-44e4-a565-bb29f025941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Volume 8799ddbc-f439-49cc-9660-58a1c7d14a09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8799ddbc-f439-49cc-9660-58a1c7d14a09', 'volume_size': 1} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1715265685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8799ddbc-f439-49cc-9660-58a1c7d14a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f1346959774941adb0fc5a78710ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:14Z,use_quota=True,user_id='07224ed51dcb4c85b9c9a588339cba85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Creating volume 8799ddbc-f439-49cc-9660-58a1c7d14a09 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:14 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8799ddbc-f439-49cc-9660-58a1c7d14a09 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:14 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8799ddbc-f439-49cc-9660-58a1c7d14a09 1073741824 Jul 03 01:19:14 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Flow 'volume_create_manager' (7f16e701-86fe-4ae8-949f-03adfde47fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b761be-261a-4cd9-881e-3557c19b230d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b761be-261a-4cd9-881e-3557c19b230d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855378788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b9fb5b-2e36-4215-80c7-1a8b42ce6299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f1346959774941adb0fc5a78710ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:15Z,use_quota=True,user_id='07224ed51dcb4c85b9c9a588339cba85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ff5c33-7e88-4681-90dd-b790a04d0788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ff5c33-7e88-4681-90dd-b790a04d0788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9115c04-eda6-4d7b-b9e5-f2da03439bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9115c04-eda6-4d7b-b9e5-f2da03439bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b9fb5b-2e36-4215-80c7-1a8b42ce6299', 'volume_name': 'volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc9eca7-9fc3-47a5-ba43-f74757b6db70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc9eca7-9fc3-47a5-ba43-f74757b6db70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e76bd6c-972f-4d98-8891-fa9c9d3df35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Volume b2b9fb5b-2e36-4215-80c7-1a8b42ce6299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299', 'volume_size': 1} Jul 03 01:19:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Flow 'volume_create_manager' (b459cea0-f87c-4c0e-a87b-2984c0317254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b4747d-53a3-4786-b7b9-4b0917bf273f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b4747d-53a3-4786-b7b9-4b0917bf273f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1611644825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3171de-8c02-48ca-8900-ff2b9e096efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f1346959774941adb0fc5a78710ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:15Z,use_quota=True,user_id='07224ed51dcb4c85b9c9a588339cba85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b42d98-1ffc-4436-be19-e07d7956874e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b42d98-1ffc-4436-be19-e07d7956874e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074f39e5-f444-48e8-b0d1-d8b819194cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074f39e5-f444-48e8-b0d1-d8b819194cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a3171de-8c02-48ca-8900-ff2b9e096efe', 'volume_name': 'volume-6a3171de-8c02-48ca-8900-ff2b9e096efe', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0f30ec-f6c6-41bb-b787-986c9efeaef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0f30ec-f6c6-41bb-b787-986c9efeaef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b04e685-7c3d-4549-b38c-eea3a65fa3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:15 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Volume 6a3171de-8c02-48ca-8900-ff2b9e096efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a3171de-8c02-48ca-8900-ff2b9e096efe', 'volume_size': 1} Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:15 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8799ddbc-f439-49cc-9660-58a1c7d14a09 1073741824" returned: 0 in 1.302s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8799ddbc-f439-49cc-9660-58a1c7d14a09 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:15 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8799ddbc-f439-49cc-9660-58a1c7d14a09 Jul 03 01:19:15 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:15 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Flow 'volume_create_manager' (4dee9d24-ad87-4235-b0e4-2cb692d99b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3152a962-b317-48da-ac06-7a79d72dcf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3152a962-b317-48da-ac06-7a79d72dcf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-400085537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc40ffbd-6389-4399-be7a-076cc4e4d134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f1346959774941adb0fc5a78710ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:16Z,use_quota=True,user_id='07224ed51dcb4c85b9c9a588339cba85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b12d4a-2439-44fa-9d86-b1ff2c0afb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b12d4a-2439-44fa-9d86-b1ff2c0afb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703addd9-c6c6-4c4b-8a2d-fbaf3bad54a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703addd9-c6c6-4c4b-8a2d-fbaf3bad54a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc40ffbd-6389-4399-be7a-076cc4e4d134', 'volume_name': 'volume-bc40ffbd-6389-4399-be7a-076cc4e4d134', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca76fdf-e32a-409a-bc11-6ff3d5a59223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca76fdf-e32a-409a-bc11-6ff3d5a59223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db977900-60b9-4aed-a226-081a03dc3b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:16 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Volume bc40ffbd-6389-4399-be7a-076cc4e4d134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc40ffbd-6389-4399-be7a-076cc4e4d134', 'volume_size': 1} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Flow 'volume_create_manager' (711c3735-7e5b-429e-82a7-688e7efa6290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c96e76-acb3-472c-98ae-8571e1736af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c96e76-acb3-472c-98ae-8571e1736af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-453151597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3aa791f-41b2-4d98-bc86-6699531156f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f1346959774941adb0fc5a78710ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:16Z,use_quota=True,user_id='07224ed51dcb4c85b9c9a588339cba85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fd11bf-2361-4dc8-9f60-b96fc924f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fd11bf-2361-4dc8-9f60-b96fc924f508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a022a2-917c-4878-a029-2487c20fb015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a022a2-917c-4878-a029-2487c20fb015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3aa791f-41b2-4d98-bc86-6699531156f6', 'volume_name': 'volume-b3aa791f-41b2-4d98-bc86-6699531156f6', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab726bd-5122-4a28-93dd-fca2d98930b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:16 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab726bd-5122-4a28-93dd-fca2d98930b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78e798e-9b3a-48af-b04e-f214f292c3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:16 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Volume b3aa791f-41b2-4d98-bc86-6699531156f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3aa791f-41b2-4d98-bc86-6699531156f6', 'volume_size': 1} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8799ddbc-f439-49cc-9660-58a1c7d14a09" returned: 0 in 0.847s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.611s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855378788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b9fb5b-2e36-4215-80c7-1a8b42ce6299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f1346959774941adb0fc5a78710ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:15Z,use_quota=True,user_id='07224ed51dcb4c85b9c9a588339cba85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Creating volume b2b9fb5b-2e36-4215-80c7-1a8b42ce6299 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:16 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cf72ac-586b-44e4-a565-bb29f025941b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8799ddbc-f439-49cc-9660-58a1c7d14a09', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:16 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299 1073741824 Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d495079f-74bb-4add-b370-16cebf612cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:16 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:16 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Volume volume-8799ddbc-f439-49cc-9660-58a1c7d14a09 (8799ddbc-f439-49cc-9660-58a1c7d14a09): created successfully Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d495079f-74bb-4add-b370-16cebf612cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Flow 'volume_create_manager' (6bbd1cb6-0b57-4c15-9cc7-087bd15c1b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-51cc1a6a-fee3-40f3-910f-85b5c31f7572 tempest-CreateVolumesFromImageTest-549440500 None] Created volume successfully. Jul 03 01:19:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a352cd66-a021-4ae3-a4a1-030ecf00154e tempest-GroupsV320Test-1862612917 None] Group tempest-GroupsV320Test-Group-360784081: creating Jul 03 01:19:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a352cd66-a021-4ae3-a4a1-030ecf00154e tempest-GroupsV320Test-1862612917 None] Group tempest-GroupsV320Test-Group-360784081: created successfully Jul 03 01:19:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a352cd66-a021-4ae3-a4a1-030ecf00154e tempest-GroupsV320Test-1862612917 None] Create group completed successfully. Jul 03 01:19:17 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299 1073741824" returned: 0 in 1.135s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:17 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299 Jul 03 01:19:17 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-b3631a05-bce5-45b9-a073-6bd0d3b80fc7 tempest-GroupsV320Test-1862612917 None] Created reservations ['87852794-164d-4f2d-b2cc-25ccfc6a1480'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b3631a05-bce5-45b9-a073-6bd0d3b80fc7 tempest-GroupsV320Test-1862612917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b3631a05-bce5-45b9-a073-6bd0d3b80fc7 tempest-GroupsV320Test-1862612917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b3631a05-bce5-45b9-a073-6bd0d3b80fc7 tempest-GroupsV320Test-1862612917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b3631a05-bce5-45b9-a073-6bd0d3b80fc7 tempest-GroupsV320Test-1862612917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b3631a05-bce5-45b9-a073-6bd0d3b80fc7 tempest-GroupsV320Test-1862612917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b3631a05-bce5-45b9-a073-6bd0d3b80fc7 tempest-GroupsV320Test-1862612917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:18 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:19:18 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:18 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299" returned: 0 in 0.674s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.841s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1611644825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3171de-8c02-48ca-8900-ff2b9e096efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f1346959774941adb0fc5a78710ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:15Z,use_quota=True,user_id='07224ed51dcb4c85b9c9a588339cba85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Creating volume 6a3171de-8c02-48ca-8900-ff2b9e096efe {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:18 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6a3171de-8c02-48ca-8900-ff2b9e096efe 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e76bd6c-972f-4d98-8891-fa9c9d3df35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:18 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6a3171de-8c02-48ca-8900-ff2b9e096efe 1073741824 Jul 03 01:19:18 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f6f15e-e48b-4458-a9d0-ddf6a490e27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:18 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Volume volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299 (b2b9fb5b-2e36-4215-80c7-1a8b42ce6299): created successfully Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f6f15e-e48b-4458-a9d0-ddf6a490e27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Flow 'volume_create_manager' (7f16e701-86fe-4ae8-949f-03adfde47fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:18 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1874bc19-05fb-4402-bc85-07a744acae78 tempest-CreateVolumesFromImageTest-549440500 None] Created volume successfully. Jul 03 01:19:19 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-84d43ff3-f5b8-45f5-9464-6b6e303c6e41 req-7d62abc7-9b3e-4bba-9110-f00d9cc3d096 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Terminate volume connection completed successfully. Jul 03 01:19:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-84d43ff3-f5b8-45f5-9464-6b6e303c6e41 req-7d62abc7-9b3e-4bba-9110-f00d9cc3d096 tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Deleting attachment 2fa079bf-1adb-4eff-af33-8df0b25bd04e. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:19:19 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b3631a05-bce5-45b9-a073-6bd0d3b80fc7 tempest-GroupsV320Test-1862612917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.726s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:19 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-b3631a05-bce5-45b9-a073-6bd0d3b80fc7 tempest-GroupsV320Test-1862612917 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:19 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b3631a05-bce5-45b9-a073-6bd0d3b80fc7 tempest-GroupsV320Test-1862612917 None] Delete group completed successfully. Jul 03 01:19:19 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6a3171de-8c02-48ca-8900-ff2b9e096efe 1073741824" returned: 0 in 0.857s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6a3171de-8c02-48ca-8900-ff2b9e096efe {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:19 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6a3171de-8c02-48ca-8900-ff2b9e096efe Jul 03 01:19:19 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:20 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6a3171de-8c02-48ca-8900-ff2b9e096efe" returned: 0 in 0.715s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-400085537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc40ffbd-6389-4399-be7a-076cc4e4d134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f1346959774941adb0fc5a78710ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:16Z,use_quota=True,user_id='07224ed51dcb4c85b9c9a588339cba85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Creating volume bc40ffbd-6389-4399-be7a-076cc4e4d134 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:20 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bc40ffbd-6389-4399-be7a-076cc4e4d134 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b04e685-7c3d-4549-b38c-eea3a65fa3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a3171de-8c02-48ca-8900-ff2b9e096efe', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662dac9d-2484-436a-b6a6-fc3c05092897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:20 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bc40ffbd-6389-4399-be7a-076cc4e4d134 1073741824 Jul 03 01:19:20 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:20 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Volume volume-6a3171de-8c02-48ca-8900-ff2b9e096efe (6a3171de-8c02-48ca-8900-ff2b9e096efe): created successfully Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662dac9d-2484-436a-b6a6-fc3c05092897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Flow 'volume_create_manager' (b459cea0-f87c-4c0e-a87b-2984c0317254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:20 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c70c7d1e-20d9-41ac-8d4a-8ee3db228cca tempest-CreateVolumesFromImageTest-549440500 None] Created volume successfully. Jul 03 01:19:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-5d3c95a2-07b2-4e1a-9d9e-13db57cac2d1 req-72a650a6-11f1-4f73-91a7-1218041377b0 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:21 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bc40ffbd-6389-4399-be7a-076cc4e4d134 1073741824" returned: 0 in 1.039s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bc40ffbd-6389-4399-be7a-076cc4e4d134 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:21 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bc40ffbd-6389-4399-be7a-076cc4e4d134 Jul 03 01:19:21 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Acquiring lock "cinder-e29517d9-13d0-46a3-8898-3d3b3bbf8c44-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Lock "cinder-e29517d9-13d0-46a3-8898-3d3b3bbf8c44-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Acquiring lock "cinder-quobyte-e29517d9-13d0-46a3-8898-3d3b3bbf8c44" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Lock "cinder-quobyte-e29517d9-13d0-46a3-8898-3d3b3bbf8c44" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:21 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[65229864-4a88-427c-8e75-37cac76faa97]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:21 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44 Jul 03 01:19:21 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:22 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bc40ffbd-6389-4399-be7a-076cc4e4d134" returned: 0 in 0.831s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.441s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-453151597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3aa791f-41b2-4d98-bc86-6699531156f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f1346959774941adb0fc5a78710ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:16Z,use_quota=True,user_id='07224ed51dcb4c85b9c9a588339cba85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Creating volume b3aa791f-41b2-4d98-bc86-6699531156f6 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:22 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3aa791f-41b2-4d98-bc86-6699531156f6 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:22 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3aa791f-41b2-4d98-bc86-6699531156f6 1073741824 Jul 03 01:19:22 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db977900-60b9-4aed-a226-081a03dc3b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc40ffbd-6389-4399-be7a-076cc4e4d134', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef9a82b-dde2-4ef4-a736-f23a854b3aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:22 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Volume volume-bc40ffbd-6389-4399-be7a-076cc4e4d134 (bc40ffbd-6389-4399-be7a-076cc4e4d134): created successfully Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef9a82b-dde2-4ef4-a736-f23a854b3aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Flow 'volume_create_manager' (4dee9d24-ad87-4235-b0e4-2cb692d99b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:22 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e74c5d07-601f-4208-bcb4-5ab3feebb477 tempest-CreateVolumesFromImageTest-549440500 None] Created volume successfully. Jul 03 01:19:22 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44" returned: 0 in 0.988s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:22 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44 Jul 03 01:19:22 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:22 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3aa791f-41b2-4d98-bc86-6699531156f6 1073741824" returned: 0 in 0.903s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3aa791f-41b2-4d98-bc86-6699531156f6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:23 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3aa791f-41b2-4d98-bc86-6699531156f6 Jul 03 01:19:23 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:23 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e29517d9-13d0-46a3-8898-3d3b3bbf8c44" returned: 0 in 0.696s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Lock "cinder-quobyte-e29517d9-13d0-46a3-8898-3d3b3bbf8c44" released by "delete_volume" :: held 1.741s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Created reservations ['4a6f2998-dbfb-437c-8b32-0518fb493abd', '149560fc-8965-47e9-88d4-cc0f3d610e0f', '617f48fe-6426-4beb-b3d8-ba9c49d6976a', 'aee121db-d1a5-4af5-b318-2bafcf730031'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:23 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:19:23 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:23 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3aa791f-41b2-4d98-bc86-6699531156f6" returned: 0 in 0.783s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-5d3c95a2-07b2-4e1a-9d9e-13db57cac2d1 req-72a650a6-11f1-4f73-91a7-1218041377b0 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.023s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78e798e-9b3a-48af-b04e-f214f292c3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3aa791f-41b2-4d98-bc86-6699531156f6', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240c3bb5-1087-4459-bde4-ae02ff50a244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d122ab3-1ad4-4624-b801-e146081af393]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-5d3c95a2-07b2-4e1a-9d9e-13db57cac2d1 req-72a650a6-11f1-4f73-91a7-1218041377b0 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:23 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Volume volume-b3aa791f-41b2-4d98-bc86-6699531156f6 (b3aa791f-41b2-4d98-bc86-6699531156f6): created successfully Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240c3bb5-1087-4459-bde4-ae02ff50a244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Flow 'volume_create_manager' (711c3735-7e5b-429e-82a7-688e7efa6290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:23 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-23e2c8e3-d963-4c56-b2a5-ad03c985c880 tempest-CreateVolumesFromImageTest-549440500 None] Created volume successfully. Jul 03 01:19:23 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d Jul 03 01:19:23 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:24 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.739s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:24 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:24 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Deleted volume successfully. Jul 03 01:19:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8dd0218b-7e02-43dc-804b-f4c9a4c5b30a tempest-TestServerVolumeAttachScenarioOldVersion-571797374 None] Lock "cinder-e29517d9-13d0-46a3-8898-3d3b3bbf8c44-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "cinder-b3aa791f-41b2-4d98-bc86-6699531156f6-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-b3aa791f-41b2-4d98-bc86-6699531156f6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "cinder-quobyte-b3aa791f-41b2-4d98-bc86-6699531156f6" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-quobyte-b3aa791f-41b2-4d98-bc86-6699531156f6" acquired by "delete_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:24 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc68925-59de-46fd-8024-3b16f8edfeeb]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3aa791f-41b2-4d98-bc86-6699531156f6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:24 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3aa791f-41b2-4d98-bc86-6699531156f6 Jul 03 01:19:24 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:24 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-5d3c95a2-07b2-4e1a-9d9e-13db57cac2d1 req-72a650a6-11f1-4f73-91a7-1218041377b0 tempest-TestServerVolumeAttachmentScenario-1870684654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d" returned: 0 in 0.933s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-5d3c95a2-07b2-4e1a-9d9e-13db57cac2d1 req-72a650a6-11f1-4f73-91a7-1218041377b0 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.969s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-5d3c95a2-07b2-4e1a-9d9e-13db57cac2d1 req-72a650a6-11f1-4f73-91a7-1218041377b0 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c40311c7-2775-4538-b411-ff7270c80a9a', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:19:24 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-5d3c95a2-07b2-4e1a-9d9e-13db57cac2d1 req-72a650a6-11f1-4f73-91a7-1218041377b0 tempest-TestServerVolumeAttachmentScenario-1870684654 None] attachment_update completed successfully. Jul 03 01:19:25 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3aa791f-41b2-4d98-bc86-6699531156f6" returned: 0 in 1.175s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3aa791f-41b2-4d98-bc86-6699531156f6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:25 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3aa791f-41b2-4d98-bc86-6699531156f6 Jul 03 01:19:25 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:26 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b3aa791f-41b2-4d98-bc86-6699531156f6" returned: 0 in 0.696s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-quobyte-b3aa791f-41b2-4d98-bc86-6699531156f6" released by "delete_volume" :: held 1.919s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Created reservations ['3c0fccb4-ea75-4cb9-addd-508b5cd917bb', 'cb589803-004e-4398-8a25-8dd6e0856a2c', 'e88ffe08-e1b9-46f1-9298-80ae62e5946c', '224bd0ae-41e2-4205-b779-950570a466c6'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:26 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:19:26 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "cinder-bc40ffbd-6389-4399-be7a-076cc4e4d134-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-bc40ffbd-6389-4399-be7a-076cc4e4d134-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "cinder-quobyte-bc40ffbd-6389-4399-be7a-076cc4e4d134" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-quobyte-bc40ffbd-6389-4399-be7a-076cc4e4d134" acquired by "delete_volume" :: waited 0.042s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[db04026a-5038-487b-a89a-b65792ef5445]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bc40ffbd-6389-4399-be7a-076cc4e4d134 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:27 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bc40ffbd-6389-4399-be7a-076cc4e4d134 Jul 03 01:19:27 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:27 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.042s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:27 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:27 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Deleted volume successfully. Jul 03 01:19:27 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-47b078e9-8c5e-4646-85e2-0041d2a9929e tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-b3aa791f-41b2-4d98-bc86-6699531156f6-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:19:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:27 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:19:27 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:28 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bc40ffbd-6389-4399-be7a-076cc4e4d134" returned: 0 in 1.220s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bc40ffbd-6389-4399-be7a-076cc4e4d134 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:28 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bc40ffbd-6389-4399-be7a-076cc4e4d134 Jul 03 01:19:28 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:28 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.816s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:19:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:19:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:19:28 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bc40ffbd-6389-4399-be7a-076cc4e4d134" returned: 0 in 0.756s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:28 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-quobyte-bc40ffbd-6389-4399-be7a-076cc4e4d134" released by "delete_volume" :: held 2.044s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:28 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Created reservations ['765b9887-3be3-4c3d-8ed2-6930ac843d37', '1f3b6a3c-ef9a-4482-9abd-5c801107cb86', '94106ba2-6c2b-4562-a487-be596ae13dcb', '6fc8d7f5-21a7-4df8-b215-8ada943ebff3'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:29 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:29 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:29 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:19:29 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:29 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.798s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:29 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:29 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Deleted volume successfully. Jul 03 01:19:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c441cc3a-c977-49fd-b9e0-7a166f599ae2 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-bc40ffbd-6389-4399-be7a-076cc4e4d134-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "cinder-6a3171de-8c02-48ca-8900-ff2b9e096efe-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-6a3171de-8c02-48ca-8900-ff2b9e096efe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "cinder-quobyte-6a3171de-8c02-48ca-8900-ff2b9e096efe" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-quobyte-6a3171de-8c02-48ca-8900-ff2b9e096efe" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:30 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1c909f-431b-49a4-a45c-fddecaf2b049]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6a3171de-8c02-48ca-8900-ff2b9e096efe {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:30 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6a3171de-8c02-48ca-8900-ff2b9e096efe Jul 03 01:19:30 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:31 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-2ff4f7f5-6ffd-4e9a-881c-81c232af05f4 req-228b7f6e-da13-4e1f-85d0-9476f522923e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Terminate volume connection completed successfully. Jul 03 01:19:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-2ff4f7f5-6ffd-4e9a-881c-81c232af05f4 req-228b7f6e-da13-4e1f-85d0-9476f522923e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Deleting attachment c40311c7-2775-4538-b411-ff7270c80a9a. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:19:31 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6a3171de-8c02-48ca-8900-ff2b9e096efe" returned: 0 in 1.004s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6a3171de-8c02-48ca-8900-ff2b9e096efe {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:31 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6a3171de-8c02-48ca-8900-ff2b9e096efe Jul 03 01:19:31 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:31 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6a3171de-8c02-48ca-8900-ff2b9e096efe" returned: 0 in 0.795s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-quobyte-6a3171de-8c02-48ca-8900-ff2b9e096efe" released by "delete_volume" :: held 1.853s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:32 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Created reservations ['a7ef8ea8-684d-448e-ae5a-66f066cc3cac', 'd1338d6a-48b2-422e-aeea-9895f2d2e2a1', 'cc113091-e2ee-44c2-b8a7-b673d8d78843', '3189faed-cd92-448f-beab-806f01512b95'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:32 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:19:32 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "cinder-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "cinder-quobyte-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-quobyte-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299" acquired by "delete_volume" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:32 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d3f3ba-a706-4063-a8d9-0c735fb8ee3a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:32 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299 Jul 03 01:19:32 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:33 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.052s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:33 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:33 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Deleted volume successfully. Jul 03 01:19:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ea5bf603-6f72-42ef-901d-6bacb19dad13 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-6a3171de-8c02-48ca-8900-ff2b9e096efe-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:33 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299" returned: 0 in 1.204s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:33 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299 Jul 03 01:19:33 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:34 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299" returned: 0 in 0.822s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-quobyte-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299" released by "delete_volume" :: held 2.094s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:34 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Created reservations ['c53f695a-3567-4be2-93f1-330aa7bc327a', 'b0b92944-a2fd-4c3c-836c-af5bd913e94a', '26ce951c-0d6f-40d1-babc-666756e479ba', '530abc50-9462-4789-8cbc-5a6a637eea9c'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:34 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:19:34 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:35 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-1b53a678-a172-4790-8ab7-6bad879091fe req-bf816ff0-f022-4a36-a761-db22122f4aad tempest-TestServerVolumeAttachmentScenario-1870684654 None] Terminate volume connection completed successfully. Jul 03 01:19:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-1b53a678-a172-4790-8ab7-6bad879091fe req-bf816ff0-f022-4a36-a761-db22122f4aad tempest-TestServerVolumeAttachmentScenario-1870684654 None] Deleting attachment 4d4fe394-39b1-44ce-ac6f-362a06c84551. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:19:35 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.834s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:35 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:35 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Deleted volume successfully. Jul 03 01:19:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3e393703-129a-4772-a974-744d6337bf51 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-b2b9fb5b-2e36-4215-80c7-1a8b42ce6299-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "cinder-8799ddbc-f439-49cc-9660-58a1c7d14a09-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-8799ddbc-f439-49cc-9660-58a1c7d14a09-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "cinder-quobyte-8799ddbc-f439-49cc-9660-58a1c7d14a09" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-quobyte-8799ddbc-f439-49cc-9660-58a1c7d14a09" acquired by "delete_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:35 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c4f023-4334-4dc0-b011-a895c6f6fc64]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8799ddbc-f439-49cc-9660-58a1c7d14a09 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:36 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8799ddbc-f439-49cc-9660-58a1c7d14a09 Jul 03 01:19:36 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:36 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8799ddbc-f439-49cc-9660-58a1c7d14a09" returned: 0 in 0.920s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8799ddbc-f439-49cc-9660-58a1c7d14a09 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:36 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8799ddbc-f439-49cc-9660-58a1c7d14a09 Jul 03 01:19:36 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:37 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8799ddbc-f439-49cc-9660-58a1c7d14a09" returned: 0 in 0.884s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-quobyte-8799ddbc-f439-49cc-9660-58a1c7d14a09" released by "delete_volume" :: held 1.870s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:37 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Created reservations ['fddd1b13-1798-4c3a-b959-6619f45bb16f', 'e11cbf14-b05c-4ce3-8219-8cc8d2e8d541', '1df99ab5-88cc-4e2b-a3e1-f4c1d01bef7c', '9f2ffac2-654f-476d-8c2d-b1922cacdec6'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:38 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:19:38 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:39 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.051s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:39 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:39 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Deleted volume successfully. Jul 03 01:19:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f176989a-3cd8-4028-9274-614063e58d08 tempest-CreateVolumesFromImageTest-549440500 None] Lock "cinder-8799ddbc-f439-49cc-9660-58a1c7d14a09-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Flow 'volume_create_manager' (ceb57d1b-549f-4f71-826b-6b114fd65fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1496a7-4ffe-433e-85bb-037bc343483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1496a7-4ffe-433e-85bb-037bc343483c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-643156265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc169bc9-4e6b-4833-99c8-33b6140c1f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb24f253cc0a4ba083f43dc24a5a21c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:43Z,use_quota=True,user_id='c31ee1a390594350a50b0681e4fbd871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5db0810-03f8-46db-81c1-db009d6ed157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5db0810-03f8-46db-81c1-db009d6ed157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348394ed-b041-41eb-a288-0f108e284972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348394ed-b041-41eb-a288-0f108e284972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc169bc9-4e6b-4833-99c8-33b6140c1f60', 'volume_name': 'volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12819d40-d3f0-4245-b648-7ea12f8a9166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12819d40-d3f0-4245-b648-7ea12f8a9166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c26b8111-91e1-4672-a4b0-f2c29dfdef7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:43 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume cc169bc9-4e6b-4833-99c8-33b6140c1f60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60', 'volume_size': 1} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-643156265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc169bc9-4e6b-4833-99c8-33b6140c1f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb24f253cc0a4ba083f43dc24a5a21c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:43Z,use_quota=True,user_id='c31ee1a390594350a50b0681e4fbd871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Creating volume cc169bc9-4e6b-4833-99c8-33b6140c1f60 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:43 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:19:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:43 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 1073741824 Jul 03 01:19:43 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:44 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 1073741824" returned: 0 in 1.077s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:44 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 Jul 03 01:19:44 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:45 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60" returned: 0 in 0.975s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] <== create_volume: return (2104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c26b8111-91e1-4672-a4b0-f2c29dfdef7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480b9555-b197-45f1-abf4-679b80c23afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:45 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 (cc169bc9-4e6b-4833-99c8-33b6140c1f60): created successfully Jul 03 01:19:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480b9555-b197-45f1-abf4-679b80c23afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Flow 'volume_create_manager' (ceb57d1b-549f-4f71-826b-6b114fd65fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:45 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3e17620d-728d-495c-a464-b2bc86144898 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Created volume successfully. Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Flow 'volume_create_manager' (b206a148-71a1-40a0-8dc7-ea3e02d18fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5fdb3c-c7d3-485f-b418-8ae9b77c6c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5fdb3c-c7d3-485f-b418-8ae9b77c6c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-160744050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb47f7bcf6d4bf2855cf27d4dabaf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:47Z,use_quota=True,user_id='9b8bada1d4b34f718dfaaeca4e73cd55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705bd20a-f274-4d6a-bc3e-2692f671d4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705bd20a-f274-4d6a-bc3e-2692f671d4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446520b2-8c8e-4c22-8d2d-cb7dbf8a9bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446520b2-8c8e-4c22-8d2d-cb7dbf8a9bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e', 'volume_name': 'volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b22872-229f-476b-9f6d-3b346038a2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b22872-229f-476b-9f6d-3b346038a2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840565ef-e75e-4b19-8cf7-f1f44cb99721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:46 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Volume 2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e', 'volume_size': 1} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] Creating offline snapshot 4ed6354f-9421-44a6-8e7a-c12737ab7053 of volume cc169bc9-4e6b-4833-99c8-33b6140c1f60 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6432abe-67c8-47a2-8f56-7dadd3076f0e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:47 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 Jul 03 01:19:47 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Acquiring lock "cinder-52f53c77-5ad4-40ef-b192-c40c52dbcd6d-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "cinder-52f53c77-5ad4-40ef-b192-c40c52dbcd6d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Acquiring lock "cinder-quobyte-52f53c77-5ad4-40ef-b192-c40c52dbcd6d" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "cinder-quobyte-52f53c77-5ad4-40ef-b192-c40c52dbcd6d" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:47 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f52307e-a71d-4458-b624-c1a4b369ebd9]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:47 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60" returned: 0 in 0.887s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:47 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 1G Jul 03 01:19:47 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:47 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d Jul 03 01:19:47 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:48 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d" returned: 0 in 0.827s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:48 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d Jul 03 01:19:48 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:48 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 1G" returned: 0 in 0.891s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:48 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 Jul 03 01:19:48 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:49 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-52f53c77-5ad4-40ef-b192-c40c52dbcd6d" returned: 0 in 0.711s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "cinder-quobyte-52f53c77-5ad4-40ef-b192-c40c52dbcd6d" released by "delete_volume" :: held 1.604s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Created reservations ['4b89e98a-bf37-4834-bcae-7fe265dc2315', '6e0eb7fe-75b4-44c9-afb6-32faca1c3e7a', 'ffcdf3b4-4efa-499d-9a41-7aeb12a126ab', '5489657d-4b8b-4e37-afa0-fc6bc937d07e'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:49 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:19:49 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:49 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053" returned: 0 in 0.805s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:49 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 is being set with open permissions: ugo+rw Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:49 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 Jul 03 01:19:49 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Acquiring lock "cinder-bf084be9-9d38-4c32-b838-8f64affc77d3-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "cinder-bf084be9-9d38-4c32-b838-8f64affc77d3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Acquiring lock "cinder-quobyte-bf084be9-9d38-4c32-b838-8f64affc77d3" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "cinder-quobyte-bf084be9-9d38-4c32-b838-8f64affc77d3" acquired by "delete_volume" :: waited 0.038s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:50 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0483cd8e-943d-4396-b9c1-5f56641ebcad]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:50 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3 Jul 03 01:19:50 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:50 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.844s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:50 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:50 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053" returned: 0 in 0.792s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:50 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Deleted volume successfully. Jul 03 01:19:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5f2cd019-ee01-49b6-83c0-cc3cd6431295 tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "cinder-52f53c77-5ad4-40ef-b192-c40c52dbcd6d-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:50 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.info Jul 03 01:19:50 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:50 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3" returned: 0 in 0.810s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:50 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3 Jul 03 01:19:50 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:51 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.info" returned: 0 in 0.674s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:51 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.info is being set with open permissions: ugo+rw Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:51 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.info Jul 03 01:19:51 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:51 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bf084be9-9d38-4c32-b838-8f64affc77d3" returned: 0 in 0.671s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "cinder-quobyte-bf084be9-9d38-4c32-b838-8f64affc77d3" released by "delete_volume" :: held 1.542s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Created reservations ['172ee01f-b857-42d3-8f12-9314108eb329', 'f0b138f8-161e-4220-8066-b2afd15c4109', '1476f957-ccbe-4c78-b074-c8986b8807aa', '4357f530-bc00-4d54-895b-7fb344c62fe6'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:51 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:19:51 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:51 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.info" returned: 0 in 0.738s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.981s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.924s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-160744050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb47f7bcf6d4bf2855cf27d4dabaf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:47Z,use_quota=True,user_id='9b8bada1d4b34f718dfaaeca4e73cd55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Creating volume 2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:51 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:19:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:51 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e 1073741824 Jul 03 01:19:51 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:51 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e688f10e-378a-4fea-ad74-a675a6d423ba tempest-CreateVolumesFromSnapshotTest-1599383814 None] Create snapshot completed successfully Jul 03 01:19:52 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.757s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:52 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Deleted volume successfully. Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fd0b2659-14a4-4fca-8881-b277a4d2094e tempest-TestServerVolumeAttachmentScenario-1870684654 None] Lock "cinder-bf084be9-9d38-4c32-b838-8f64affc77d3-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=124,cinder:INSERT=35,cinder:UPDATE=121,cinder:DELETE=12 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=103,cinder:UPDATE=130,cinder:INSERT=31,cinder:DELETE=9 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Flow 'volume_create_manager' (a5c024cc-2a44-42d9-96b6-ce0ebefd3807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba4a6e2-7d0b-4a68-89d5-96042fe92d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba4a6e2-7d0b-4a68-89d5-96042fe92d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91274139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fb93a5-5978-45e9-ac51-ed55151540e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb24f253cc0a4ba083f43dc24a5a21c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:53Z,use_quota=True,user_id='c31ee1a390594350a50b0681e4fbd871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885cd16a-f851-4404-b39e-99c769b2f999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885cd16a-f851-4404-b39e-99c769b2f999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac9a6fd-d285-4aa9-ae30-d94dfb7136a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac9a6fd-d285-4aa9-ae30-d94dfb7136a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65fb93a5-5978-45e9-ac51-ed55151540e0', 'volume_name': 'volume-65fb93a5-5978-45e9-ac51-ed55151540e0', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6930110e-5bb7-4c77-a991-460abe9018ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6930110e-5bb7-4c77-a991-460abe9018ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b9a357-4248-4ceb-83af-2c06e4382175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:52 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume 65fb93a5-5978-45e9-ac51-ed55151540e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65fb93a5-5978-45e9-ac51-ed55151540e0', 'volume_size': 1} Jul 03 01:19:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:53 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e 1073741824" returned: 0 in 1.298s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:53 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e Jul 03 01:19:53 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Flow 'volume_create_manager' (513de9aa-5365-4e26-b720-4993a9ececa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d349aa-2c75-45d1-8b40-1f0e4603c7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d349aa-2c75-45d1-8b40-1f0e4603c7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc09dcf-3dc5-48ed-906b-5980814a426a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='479efbb7a1e54749a4694ad223c2acc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:53Z,use_quota=True,user_id='9e57d931945f4302967d63d4081bd54b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144d201b-d899-4300-9f4f-a0f5cf8b928e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144d201b-d899-4300-9f4f-a0f5cf8b928e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397bddfa-f428-4a08-85f9-c6be18ff3f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.image.glance [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Creating Keystone auth plugin from conf {{(pid=86357) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Flow 'volume_create_manager' (f34f2c84-8408-4d0d-9feb-c6d678da3fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4427f26e-6de6-43d6-8616-824f99d7296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4427f26e-6de6-43d6-8616-824f99d7296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1674848564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7171aed5-43a8-4e22-b592-7065f8745258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb24f253cc0a4ba083f43dc24a5a21c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:53Z,use_quota=True,user_id='c31ee1a390594350a50b0681e4fbd871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf1d178-75d0-4bfb-b2fb-2780851b594e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf1d178-75d0-4bfb-b2fb-2780851b594e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01c28a5-2f89-4b8a-b18d-73b3cd53941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01c28a5-2f89-4b8a-b18d-73b3cd53941b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7171aed5-43a8-4e22-b592-7065f8745258', 'volume_name': 'volume-7171aed5-43a8-4e22-b592-7065f8745258', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a143bb5-34fc-47f3-821a-a1297c21978b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a143bb5-34fc-47f3-821a-a1297c21978b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb445f1c-4cdf-4e5b-bb63-cc98d6d91741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:53 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume 7171aed5-43a8-4e22-b592-7065f8745258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7171aed5-43a8-4e22-b592-7065f8745258', 'volume_size': 1} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Flow 'volume_create_manager' (d28cf1d4-ba23-4905-993d-2602afd1e2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84091abd-85c1-458a-9e4b-42d863e36407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84091abd-85c1-458a-9e4b-42d863e36407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1759953473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdceb20-0784-4346-a9cd-1eaf3fd3ec79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb24f253cc0a4ba083f43dc24a5a21c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:54Z,use_quota=True,user_id='c31ee1a390594350a50b0681e4fbd871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908e20d6-8e91-42cc-9b2f-558011912a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908e20d6-8e91-42cc-9b2f-558011912a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c110250-586f-430d-8c5a-f0e987675b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c110250-586f-430d-8c5a-f0e987675b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fdceb20-0784-4346-a9cd-1eaf3fd3ec79', 'volume_name': 'volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4f8f7e-c072-4c11-90aa-994ae1bab7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4f8f7e-c072-4c11-90aa-994ae1bab7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8556f7ef-ee82-44a6-8986-ca621d18f076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:53 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume 0fdceb20-0784-4346-a9cd-1eaf3fd3ec79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79', 'volume_size': 1} Jul 03 01:19:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397bddfa-f428-4a08-85f9-c6be18ff3f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bfc09dcf-3dc5-48ed-906b-5980814a426a', 'volume_name': 'volume-bfc09dcf-3dc5-48ed-906b-5980814a426a', 'volume_size': 1, 'image_id': '14cd1996-8725-47eb-a81c-10a42018ac93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14cd1996-8725-47eb-a81c-10a42018ac93', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edd20185dae801d36a66412cea293457', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '479efbb7a1e54749a4694ad223c2acc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf14e95fc1572fa05bbe21bf2b6f428d506500d012295d052ccd326c256f1030e3d2a367cca25068274aa67631759ad7f7a035e4aedaed6e1faa64ee1836819e', 'id': '14cd1996-8725-47eb-a81c-10a42018ac93', 'created_at': datetime.datetime(2026, 7, 2, 23, 19, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 19, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14cd1996-8725-47eb-a81c-10a42018ac93/file', 'properties': {}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dd9ca0-cc5e-4198-8d37-68a5c7380784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dd9ca0-cc5e-4198-8d37-68a5c7380784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16275528-b1ba-4e08-8c58-481ef1e373ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:54 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Volume bfc09dcf-3dc5-48ed-906b-5980814a426a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bfc09dcf-3dc5-48ed-906b-5980814a426a', 'volume_size': 1, 'image_id': '14cd1996-8725-47eb-a81c-10a42018ac93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14cd1996-8725-47eb-a81c-10a42018ac93', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edd20185dae801d36a66412cea293457', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '479efbb7a1e54749a4694ad223c2acc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf14e95fc1572fa05bbe21bf2b6f428d506500d012295d052ccd326c256f1030e3d2a367cca25068274aa67631759ad7f7a035e4aedaed6e1faa64ee1836819e', 'id': '14cd1996-8725-47eb-a81c-10a42018ac93', 'created_at': datetime.datetime(2026, 7, 2, 23, 19, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 19, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14cd1996-8725-47eb-a81c-10a42018ac93/file', 'properties': {}}, 'image_service': } Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Trying to clone bfc09dcf-3dc5-48ed-906b-5980814a426a from image 14cd1996-8725-47eb-a81c-10a42018ac93 at location (None, [{'url': 'file:///opt/stack/data/glance/images/14cd1996-8725-47eb-a81c-10a42018ac93', 'metadata': {}}]). {{(pid=86357) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:19:54 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Image download 0.00 MB at 0.00 MB/s Jul 03 01:19:54 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e" returned: 0 in 1.087s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] <== create_volume: return (2432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.435s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91274139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fb93a5-5978-45e9-ac51-ed55151540e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb24f253cc0a4ba083f43dc24a5a21c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:53Z,use_quota=True,user_id='c31ee1a390594350a50b0681e4fbd871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Creating volume 65fb93a5-5978-45e9-ac51-ed55151540e0 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:54 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-65fb93a5-5978-45e9-ac51-ed55151540e0 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:54 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-65fb93a5-5978-45e9-ac51-ed55151540e0 1073741824 Jul 03 01:19:54 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c313f13-93c0-4e5b-b897-be3c45b8d6cf]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840565ef-e75e-4b19-8cf7-f1f44cb99721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9448dbd-6cfe-4590-b09b-db7d21c23c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:54 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Volume volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e (2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e): created successfully Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9448dbd-6cfe-4590-b09b-db7d21c23c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Flow 'volume_create_manager' (b206a148-71a1-40a0-8dc7-ea3e02d18fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Flow 'volume_create_manager' (75469455-940d-4720-85ee-8784813d8a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b8ac52-fe02-4bfe-9f7c-2e41320ffcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:54 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-87a7d75d-0709-4928-8886-92049d5bbec7 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Created volume successfully. Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b8ac52-fe02-4bfe-9f7c-2e41320ffcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943502064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9167fe01-1aa6-4c11-a2da-6d0c9d1b5971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb24f253cc0a4ba083f43dc24a5a21c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:54Z,use_quota=True,user_id='c31ee1a390594350a50b0681e4fbd871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4950a895-da0c-4422-b831-497b5b66f99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4950a895-da0c-4422-b831-497b5b66f99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab0e7b4-38d5-4275-8a7a-8e8db21ffff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab0e7b4-38d5-4275-8a7a-8e8db21ffff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9167fe01-1aa6-4c11-a2da-6d0c9d1b5971', 'volume_name': 'volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:54 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD Jul 03 01:19:54 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3e3f4b-265f-4802-afe0-e695e30ec496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3e3f4b-265f-4802-afe0-e695e30ec496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bab5c49-b4ac-443c-8631-41ff45ca5486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:54 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume 9167fe01-1aa6-4c11-a2da-6d0c9d1b5971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971', 'volume_size': 1} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Flow 'volume_create_manager' (8ce79f4e-601c-40e3-aba4-be5eb6a2e7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5ec086-00ef-453c-9f50-1e0ff45b4fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5ec086-00ef-453c-9f50-1e0ff45b4fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770018057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db1a39f-91f8-4e75-a3cf-20d2a28029f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb24f253cc0a4ba083f43dc24a5a21c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:55Z,use_quota=True,user_id='c31ee1a390594350a50b0681e4fbd871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa6b1c1-9ca8-4e56-a87c-017344c2fdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa6b1c1-9ca8-4e56-a87c-017344c2fdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7aeafd-2aed-4a2c-89cc-4cf67c00fd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7aeafd-2aed-4a2c-89cc-4cf67c00fd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db1a39f-91f8-4e75-a3cf-20d2a28029f9', 'volume_name': 'volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f69d8a-d777-461a-85b1-64281bcb3284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f69d8a-d777-461a-85b1-64281bcb3284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9255fd8-2b00-4167-a2c0-60a38fcae430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:55 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume 7db1a39f-91f8-4e75-a3cf-20d2a28029f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9', 'volume_size': 1} Jul 03 01:19:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:55 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD" returned: 0 in 0.979s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:55 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD Jul 03 01:19:55 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:55 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-65fb93a5-5978-45e9-ac51-ed55151540e0 1073741824" returned: 0 in 1.253s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-65fb93a5-5978-45e9-ac51-ed55151540e0 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:55 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-65fb93a5-5978-45e9-ac51-ed55151540e0 Jul 03 01:19:55 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:56 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD" returned: 1 in 0.896s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Temporary image 14cd1996-8725-47eb-a81c-10a42018ac93 is fetched for user 9e57d931945f4302967d63d4081bd54b. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbfd76b-6ae0-42e4-8070-6c7430e562bb]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:56 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD Jul 03 01:19:56 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:56 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-65fb93a5-5978-45e9-ac51-ed55151540e0" returned: 0 in 1.020s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] <== create_volume: return (2323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.326s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.880s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1674848564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7171aed5-43a8-4e22-b592-7065f8745258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb24f253cc0a4ba083f43dc24a5a21c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:53Z,use_quota=True,user_id='c31ee1a390594350a50b0681e4fbd871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Creating volume 7171aed5-43a8-4e22-b592-7065f8745258 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:56 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7171aed5-43a8-4e22-b592-7065f8745258 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:56 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7171aed5-43a8-4e22-b592-7065f8745258 1073741824 Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b9a357-4248-4ceb-83af-2c06e4382175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65fb93a5-5978-45e9-ac51-ed55151540e0', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:56 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39df1656-3b5d-4d84-9bb7-841566c7715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:56 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume volume-65fb93a5-5978-45e9-ac51-ed55151540e0 (65fb93a5-5978-45e9-ac51-ed55151540e0): created successfully Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39df1656-3b5d-4d84-9bb7-841566c7715c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Flow 'volume_create_manager' (a5c024cc-2a44-42d9-96b6-ce0ebefd3807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:56 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-714c60d2-c111-43e0-a335-769c29565672 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Created volume successfully. Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Acquiring lock "cinder-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Lock "cinder-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Acquiring lock "cinder-quobyte-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Lock "cinder-quobyte-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb7ad81-f371-42e4-bc37-561863635f8b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:57 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e Jul 03 01:19:57 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:57 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD" returned: 0 in 1.048s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:57 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD Jul 03 01:19:57 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:57 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7171aed5-43a8-4e22-b592-7065f8745258 1073741824" returned: 0 in 1.164s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7171aed5-43a8-4e22-b592-7065f8745258 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:57 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7171aed5-43a8-4e22-b592-7065f8745258 Jul 03 01:19:57 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:57 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e" returned: 0 in 1.003s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:57 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e Jul 03 01:19:57 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:58 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD" returned: 1 in 0.882s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:58 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7171aed5-43a8-4e22-b592-7065f8745258" returned: 0 in 0.841s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.720s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1759953473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdceb20-0784-4346-a9cd-1eaf3fd3ec79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb24f253cc0a4ba083f43dc24a5a21c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:54Z,use_quota=True,user_id='c31ee1a390594350a50b0681e4fbd871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Creating volume 0fdceb20-0784-4346-a9cd-1eaf3fd3ec79 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:58 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:58 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79 1073741824 Jul 03 01:19:58 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb445f1c-4cdf-4e5b-bb63-cc98d6d91741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7171aed5-43a8-4e22-b592-7065f8745258', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ab52f4-3e7a-4917-90b4-4b85d9ea5b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:58 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume volume-7171aed5-43a8-4e22-b592-7065f8745258 (7171aed5-43a8-4e22-b592-7065f8745258): created successfully Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ab52f4-3e7a-4917-90b4-4b85d9ea5b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Flow 'volume_create_manager' (f34f2c84-8408-4d0d-9feb-c6d678da3fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:58 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c8f6ede8-4349-4a9e-83d1-3bc8e6d71cfb tempest-CreateVolumesFromSnapshotTest-1599383814 None] Created volume successfully. Jul 03 01:19:58 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e" returned: 0 in 0.880s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Lock "cinder-quobyte-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e" released by "delete_volume" :: held 1.966s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Created reservations ['8a9ea108-4837-4974-a0e6-4e1658dad9b1', '4b3221a9-0308-4a46-bd89-e73d1c3e0469', '15d3b128-6600-4f89-94d1-735dc7bb4428', '4d610c0e-e67f-4ba9-8400-f0a3b0318833'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:58 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:19:58 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:59 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.867s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:59 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:59 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Deleted volume successfully. Jul 03 01:19:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37ef41cd-6910-4c17-a716-347dcae56468 tempest-VolumeQuotasNegativeTestJSON-667230711 None] Lock "cinder-2bc4f2b5-57bd-4c7d-97ab-9d43e1e1828e-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:59 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79 1073741824" returned: 0 in 1.216s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:59 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79 Jul 03 01:19:59 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:00 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79" returned: 0 in 0.786s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.144s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943502064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9167fe01-1aa6-4c11-a2da-6d0c9d1b5971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb24f253cc0a4ba083f43dc24a5a21c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:54Z,use_quota=True,user_id='c31ee1a390594350a50b0681e4fbd871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Creating volume 9167fe01-1aa6-4c11-a2da-6d0c9d1b5971 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:00 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:00 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971 1073741824 Jul 03 01:20:00 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8556f7ef-ee82-44a6-8986-ca621d18f076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198d767b-b4c4-451b-ad52-f077a9d6caf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:00 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79 (0fdceb20-0784-4346-a9cd-1eaf3fd3ec79): created successfully Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198d767b-b4c4-451b-ad52-f077a9d6caf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Flow 'volume_create_manager' (d28cf1d4-ba23-4905-993d-2602afd1e2e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:00 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-95dc834e-2eb0-42ab-94f5-0a81d2588be0 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Created volume successfully. Jul 03 01:20:01 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971 1073741824" returned: 0 in 0.968s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:01 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971 Jul 03 01:20:01 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:02 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971" returned: 0 in 0.823s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.562s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770018057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db1a39f-91f8-4e75-a3cf-20d2a28029f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb24f253cc0a4ba083f43dc24a5a21c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:55Z,use_quota=True,user_id='c31ee1a390594350a50b0681e4fbd871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Creating volume 7db1a39f-91f8-4e75-a3cf-20d2a28029f9 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:02 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bab5c49-b4ac-443c-8631-41ff45ca5486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4624f1c2-d5e1-4174-8017-ba1de1658783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:02 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9 1073741824 Jul 03 01:20:02 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:02 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971 (9167fe01-1aa6-4c11-a2da-6d0c9d1b5971): created successfully Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4624f1c2-d5e1-4174-8017-ba1de1658783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Flow 'volume_create_manager' (75469455-940d-4720-85ee-8784813d8a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:02 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-67478cb1-6ca3-4ab0-ae39-3c7a510fa415 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Created volume successfully. Jul 03 01:20:03 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9 1073741824" returned: 0 in 1.093s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:03 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9 Jul 03 01:20:03 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:04 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9" returned: 0 in 0.720s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.135s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc09dcf-3dc5-48ed-906b-5980814a426a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='479efbb7a1e54749a4694ad223c2acc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:53Z,use_quota=True,user_id='9e57d931945f4302967d63d4081bd54b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Creating volume bfc09dcf-3dc5-48ed-906b-5980814a426a {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:04 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:04 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a 1073741824 Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9255fd8-2b00-4167-a2c0-60a38fcae430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:04 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd1573b-5885-4e36-ad22-8094fd4b2591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:04 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Volume volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9 (7db1a39f-91f8-4e75-a3cf-20d2a28029f9): created successfully Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd1573b-5885-4e36-ad22-8094fd4b2591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Flow 'volume_create_manager' (8ce79f4e-601c-40e3-aba4-be5eb6a2e7e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:04 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d9f49ef1-461e-4907-a235-52bf6f9448ab tempest-CreateVolumesFromSnapshotTest-1599383814 None] Created volume successfully. Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-7db1a39f-91f8-4e75-a3cf-20d2a28029f9-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-7db1a39f-91f8-4e75-a3cf-20d2a28029f9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-quobyte-7db1a39f-91f8-4e75-a3cf-20d2a28029f9" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-7db1a39f-91f8-4e75-a3cf-20d2a28029f9" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5699bad-a36f-4f72-a83c-edda1b62541d]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:05 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9 Jul 03 01:20:05 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:05 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a 1073741824" returned: 0 in 0.986s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:05 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a Jul 03 01:20:05 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Flow 'volume_create_manager' (eb71d675-079d-4452-b8e8-0ec05cb03b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d2acbd-f102-471a-b27f-a0db7ca0ce31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d2acbd-f102-471a-b27f-a0db7ca0ce31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1753960493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae30f0b-f50f-4033-80c0-ad450cb41ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de911c6c06f4fbd93f81374746dc170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:06Z,use_quota=True,user_id='bba7f8e2a1904ae0b719d6667e44434b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba001ae-a1a6-452e-b3e2-6043ea59d393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba001ae-a1a6-452e-b3e2-6043ea59d393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d78cf81-16d5-453f-a194-1c4531163c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d78cf81-16d5-453f-a194-1c4531163c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ae30f0b-f50f-4033-80c0-ad450cb41ce2', 'volume_name': 'volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111d734b-9f8c-4a9f-9c74-a31d00bf9c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111d734b-9f8c-4a9f-9c74-a31d00bf9c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff1a522-96c3-43ec-b673-e35c9bda5e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:06 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Volume 8ae30f0b-f50f-4033-80c0-ad450cb41ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2', 'volume_size': 1} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:06 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9" returned: 0 in 0.991s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:06 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9 Jul 03 01:20:06 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:06 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a" returned: 0 in 0.856s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1753960493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae30f0b-f50f-4033-80c0-ad450cb41ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de911c6c06f4fbd93f81374746dc170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:06Z,use_quota=True,user_id='bba7f8e2a1904ae0b719d6667e44434b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Creating volume 8ae30f0b-f50f-4033-80c0-ad450cb41ce2 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:06 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:06 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2 1073741824 Jul 03 01:20:06 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Attempting download of 14cd1996-8725-47eb-a81c-10a42018ac93 ((None, [{'url': 'file:///opt/stack/data/glance/images/14cd1996-8725-47eb-a81c-10a42018ac93', 'metadata': {}}])) to volume bfc09dcf-3dc5-48ed-906b-5980814a426a. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bdd0a4-91e6-4de1-b0a7-9c5f1ffcdb60]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14cd1996-8725-47eb-a81c-10a42018ac93_yndqi15f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:06 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14cd1996-8725-47eb-a81c-10a42018ac93_yndqi15f Jul 03 01:20:06 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7db1a39f-91f8-4e75-a3cf-20d2a28029f9" returned: 0 in 0.845s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:07 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-7db1a39f-91f8-4e75-a3cf-20d2a28029f9" released by "delete_volume" :: held 1.887s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Created reservations ['4c2ec08d-786a-4344-8fd6-da0c2c192db8', 'e8e38a40-eba0-40e7-b8a9-aa43b3150b85', '8f96bc86-7749-4d8b-ae44-540f82a00da0', '49092736-eec9-4138-b8ac-3e84ea54f303'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:07 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:20:07 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-quobyte-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971" acquired by "delete_volume" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0108bd-ccfe-412e-8044-f9d451c28c61]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:07 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14cd1996-8725-47eb-a81c-10a42018ac93_yndqi15f" returned: 0 in 1.175s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14cd1996-8725-47eb-a81c-10a42018ac93_yndqi15f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:07 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2 1073741824" returned: 0 in 1.294s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:07 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971 Jul 03 01:20:07 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:07 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2 Jul 03 01:20:07 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:07 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14cd1996-8725-47eb-a81c-10a42018ac93_yndqi15f Jul 03 01:20:07 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:08 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.770s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:08 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Deleted volume successfully. Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3010263d-3391-4ba6-910c-4f29c93472bd tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-7db1a39f-91f8-4e75-a3cf-20d2a28029f9-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:08 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971" returned: 0 in 0.979s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:08 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971 Jul 03 01:20:08 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:08 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2" returned: 0 in 0.832s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff1a522-96c3-43ec-b673-e35c9bda5e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601125e3-7c2e-46b4-b491-8ec637d83106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:08 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Volume volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2 (8ae30f0b-f50f-4033-80c0-ad450cb41ce2): created successfully Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601125e3-7c2e-46b4-b491-8ec637d83106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Flow 'volume_create_manager' (eb71d675-079d-4452-b8e8-0ec05cb03b0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:08 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9f039d0b-2041-443a-b433-40800e9c38ca tempest-VolumesListAdminTestJSON-1942238397 None] Created volume successfully. Jul 03 01:20:08 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14cd1996-8725-47eb-a81c-10a42018ac93_yndqi15f" returned: 1 in 1.041s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14cd1996-8725-47eb-a81c-10a42018ac93_yndqi15f' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cec09a-1567-40a8-8d9d-64b219ec2503]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:08 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD Jul 03 01:20:08 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:09 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971" returned: 0 in 0.798s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971" released by "delete_volume" :: held 1.826s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Created reservations ['dc699508-76a2-4245-a005-e3c52623fb52', '5646835d-6288-4010-8280-d794fd70fa92', '2cfebaba-e5d3-4541-804d-f8868b0cdd00', '2dfb8a40-a97a-4e9e-bb49-758a3d9c8798'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:09 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:20:09 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:09 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD" returned: 0 in 1.018s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:09 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD Jul 03 01:20:09 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Flow 'volume_create_manager' (de106da9-c4b5-4849-8632-dcd5e485d521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63a1619-f253-4251-ad1c-cef517fdefe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63a1619-f253-4251-ad1c-cef517fdefe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1689529077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed47813d-b839-4338-a3b5-fb7b3ee00204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de911c6c06f4fbd93f81374746dc170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:10Z,use_quota=True,user_id='bba7f8e2a1904ae0b719d6667e44434b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfca5c3-7cda-4e01-ad8f-9c690ea2fae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfca5c3-7cda-4e01-ad8f-9c690ea2fae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3807fd-c9d5-4659-b899-49c0bd094450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3807fd-c9d5-4659-b899-49c0bd094450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed47813d-b839-4338-a3b5-fb7b3ee00204', 'volume_name': 'volume-ed47813d-b839-4338-a3b5-fb7b3ee00204', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1b9299-861e-42b0-ac14-5a898da47cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1b9299-861e-42b0-ac14-5a898da47cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01574ddd-eb3b-43ed-9511-c5c186722150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:09 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Volume ed47813d-b839-4338-a3b5-fb7b3ee00204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed47813d-b839-4338-a3b5-fb7b3ee00204', 'volume_size': 1} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1689529077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed47813d-b839-4338-a3b5-fb7b3ee00204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de911c6c06f4fbd93f81374746dc170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:10Z,use_quota=True,user_id='bba7f8e2a1904ae0b719d6667e44434b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Creating volume ed47813d-b839-4338-a3b5-fb7b3ee00204 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:09 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:20:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ed47813d-b839-4338-a3b5-fb7b3ee00204 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-quobyte-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:10 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ed47813d-b839-4338-a3b5-fb7b3ee00204 1073741824 Jul 03 01:20:10 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79" acquired by "delete_volume" :: waited 0.040s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:10 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea4a044-de24-4d2a-8fec-f12790c44b39]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:10 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79 Jul 03 01:20:10 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:10 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.899s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:10 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:10 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Deleted volume successfully. Jul 03 01:20:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-514de8e2-7561-451f-a551-7b49d3555e32 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-9167fe01-1aa6-4c11-a2da-6d0c9d1b5971-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:10 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD" returned: 1 in 1.192s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:20:10 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] 14cd1996-8725-47eb-a81c-10a42018ac93 was raw, converting to raw {{(pid=86357) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:20:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:10 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a Jul 03 01:20:10 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:10 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79" returned: 0 in 0.905s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:11 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79 Jul 03 01:20:11 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:11 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ed47813d-b839-4338-a3b5-fb7b3ee00204 1073741824" returned: 0 in 1.138s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ed47813d-b839-4338-a3b5-fb7b3ee00204 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:11 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ed47813d-b839-4338-a3b5-fb7b3ee00204 Jul 03 01:20:11 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:11 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79" returned: 0 in 0.748s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:11 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79" released by "delete_volume" :: held 1.721s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:11 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a" returned: 0 in 1.007s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:11 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14cd1996-8725-47eb-a81c-10a42018ac93_p66w50fudevstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:20:11 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 01:20:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:11 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Created reservations ['41cb2756-4701-4b78-bfd7-17cd75a08d1b', 'd8a8289d-4dc8-4d63-b213-a79d37088cd0', '6f48e2a4-f388-441a-ae26-4b4fa4c04c6c', '356b249d-59bc-461b-98fb-f5698f00d0ef'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:11 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a 1G Jul 03 01:20:11 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:12 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ed47813d-b839-4338-a3b5-fb7b3ee00204" returned: 0 in 0.955s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:12 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:20:12 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01574ddd-eb3b-43ed-9511-c5c186722150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed47813d-b839-4338-a3b5-fb7b3ee00204', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c74ea93-bff9-427f-aaa9-3812b149382a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:12 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Volume volume-ed47813d-b839-4338-a3b5-fb7b3ee00204 (ed47813d-b839-4338-a3b5-fb7b3ee00204): created successfully Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c74ea93-bff9-427f-aaa9-3812b149382a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Flow 'volume_create_manager' (de106da9-c4b5-4849-8632-dcd5e485d521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:12 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7e09b379-e88e-4410-91d6-d1ff5ec18219 tempest-VolumesListAdminTestJSON-1942238397 None] Created volume successfully. Jul 03 01:20:12 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a 1G" returned: 0 in 0.801s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa39e2f-46c9-4c34-a23c-fa94b9b9e8db]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:12 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.819s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:12 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Deleted volume successfully. Jul 03 01:20:12 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a Jul 03 01:20:12 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-63800c57-7036-4cc0-86f2-960194dc39e8 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-0fdceb20-0784-4346-a9cd-1eaf3fd3ec79-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-7171aed5-43a8-4e22-b592-7065f8745258-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-7171aed5-43a8-4e22-b592-7065f8745258-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-quobyte-7171aed5-43a8-4e22-b592-7065f8745258" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-7171aed5-43a8-4e22-b592-7065f8745258" acquired by "delete_volume" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9560dabf-be87-4f90-930b-72c1e3b18055]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7171aed5-43a8-4e22-b592-7065f8745258 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:13 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7171aed5-43a8-4e22-b592-7065f8745258 Jul 03 01:20:13 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:13 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a" returned: 0 in 0.979s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Flow 'volume_create_manager' (3f407576-ad6b-403a-b8d2-053f1b24abcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3648df92-71bd-437b-b0a6-25f40cb37128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3648df92-71bd-437b-b0a6-25f40cb37128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-251960182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f53020-87fb-46f3-a9e8-bab0544ff3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de911c6c06f4fbd93f81374746dc170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:14Z,use_quota=True,user_id='bba7f8e2a1904ae0b719d6667e44434b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9fd55c-0cb7-47b7-9b0c-4d6eb0490e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9fd55c-0cb7-47b7-9b0c-4d6eb0490e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabd03e9-757e-4557-abda-d2d72d54891e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabd03e9-757e-4557-abda-d2d72d54891e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f53020-87fb-46f3-a9e8-bab0544ff3ac', 'volume_name': 'volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dca6c18-505d-4423-9f46-d1bb3b515573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dca6c18-505d-4423-9f46-d1bb3b515573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84f927e-86cd-4542-937d-88631c6eeadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:13 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Volume d9f53020-87fb-46f3-a9e8-bab0544ff3ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac', 'volume_size': 1} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-251960182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f53020-87fb-46f3-a9e8-bab0544ff3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de911c6c06f4fbd93f81374746dc170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:14Z,use_quota=True,user_id='bba7f8e2a1904ae0b719d6667e44434b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Creating volume d9f53020-87fb-46f3-a9e8-bab0544ff3ac {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:14 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a Jul 03 01:20:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:14 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:20:14 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:14 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac 1073741824 Jul 03 01:20:14 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:14 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7171aed5-43a8-4e22-b592-7065f8745258" returned: 0 in 1.044s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7171aed5-43a8-4e22-b592-7065f8745258 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:14 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7171aed5-43a8-4e22-b592-7065f8745258 Jul 03 01:20:14 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:15 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a" returned: 1 in 1.410s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Downloaded image 14cd1996-8725-47eb-a81c-10a42018ac93 ((None, [{'url': 'file:///opt/stack/data/glance/images/14cd1996-8725-47eb-a81c-10a42018ac93', 'metadata': {}}])) to volume bfc09dcf-3dc5-48ed-906b-5980814a426a successfully. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Temporary image 14cd1996-8725-47eb-a81c-10a42018ac93 for user 9e57d931945f4302967d63d4081bd54b is deleted. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Marking volume bfc09dcf-3dc5-48ed-906b-5980814a426a as bootable. {{(pid=86357) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Copying metadata from image 14cd1996-8725-47eb-a81c-10a42018ac93 to bfc09dcf-3dc5-48ed-906b-5980814a426a. {{(pid=86357) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Creating volume glance metadata for volume bfc09dcf-3dc5-48ed-906b-5980814a426a backed by image 14cd1996-8725-47eb-a81c-10a42018ac93 with: {'image_id': '14cd1996-8725-47eb-a81c-10a42018ac93', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'edd20185dae801d36a66412cea293457', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86357) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16275528-b1ba-4e08-8c58-481ef1e373ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfc09dcf-3dc5-48ed-906b-5980814a426a', 'volume_size': 1, 'image_id': '14cd1996-8725-47eb-a81c-10a42018ac93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14cd1996-8725-47eb-a81c-10a42018ac93', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edd20185dae801d36a66412cea293457', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '479efbb7a1e54749a4694ad223c2acc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf14e95fc1572fa05bbe21bf2b6f428d506500d012295d052ccd326c256f1030e3d2a367cca25068274aa67631759ad7f7a035e4aedaed6e1faa64ee1836819e', 'id': '14cd1996-8725-47eb-a81c-10a42018ac93', 'created_at': datetime.datetime(2026, 7, 2, 23, 19, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 19, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14cd1996-8725-47eb-a81c-10a42018ac93/file', 'properties': {}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300e2640-9e10-4edc-b621-63b44d4033ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:15 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Volume volume-bfc09dcf-3dc5-48ed-906b-5980814a426a (bfc09dcf-3dc5-48ed-906b-5980814a426a): created successfully Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300e2640-9e10-4edc-b621-63b44d4033ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Flow 'volume_create_manager' (513de9aa-5365-4e26-b720-4993a9ececa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:15 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3ba07dfe-dfe3-4956-ae02-a4497aa67712 tempest-VolumeImageDependencyTests-1603391942 None] Created volume successfully. Jul 03 01:20:15 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-7171aed5-43a8-4e22-b592-7065f8745258" returned: 0 in 0.970s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:15 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-7171aed5-43a8-4e22-b592-7065f8745258" released by "delete_volume" :: held 2.089s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac 1073741824" returned: 0 in 1.433s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:15 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac Jul 03 01:20:15 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Created reservations ['631fe03a-cfc7-4ec7-a431-3f92103095e1', '7c9cabb1-a286-4668-b204-058c3525a087', '05f51106-0221-45b9-8328-f67d6ab0787b', '3a7e9850-5cb1-4a91-80ff-d910f7e999c7'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:15 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:20:15 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Acquiring lock "cinder-bfc09dcf-3dc5-48ed-906b-5980814a426a-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Lock "cinder-bfc09dcf-3dc5-48ed-906b-5980814a426a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Acquiring lock "cinder-quobyte-bfc09dcf-3dc5-48ed-906b-5980814a426a" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Lock "cinder-quobyte-bfc09dcf-3dc5-48ed-906b-5980814a426a" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d63326a-2f10-43a4-a407-a5495a5722ae]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:16 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac" returned: 0 in 0.928s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] <== create_volume: return (2419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84f927e-86cd-4542-937d-88631c6eeadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2bc154-dc0b-4191-87c2-a605aab8cdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:16 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Volume volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac (d9f53020-87fb-46f3-a9e8-bab0544ff3ac): created successfully Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2bc154-dc0b-4191-87c2-a605aab8cdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Flow 'volume_create_manager' (3f407576-ad6b-403a-b8d2-053f1b24abcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f0850c2e-1ef1-4578-9dd5-a72c7ab1a23e tempest-VolumesListAdminTestJSON-1942238397 None] Created volume successfully. Jul 03 01:20:16 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.974s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:16 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a Jul 03 01:20:16 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Deleted volume successfully. Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-82316864-2477-4c14-9f76-23bccb7f29e6 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-7171aed5-43a8-4e22-b592-7065f8745258-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-65fb93a5-5978-45e9-ac51-ed55151540e0-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-65fb93a5-5978-45e9-ac51-ed55151540e0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-quobyte-65fb93a5-5978-45e9-ac51-ed55151540e0" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-65fb93a5-5978-45e9-ac51-ed55151540e0" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33adf8c-1adf-45e2-8c83-bf05ed541447]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-65fb93a5-5978-45e9-ac51-ed55151540e0 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:17 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-65fb93a5-5978-45e9-ac51-ed55151540e0 Jul 03 01:20:17 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:17 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a" returned: 0 in 1.343s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:17 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a Jul 03 01:20:17 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:18 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-65fb93a5-5978-45e9-ac51-ed55151540e0" returned: 0 in 1.273s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-65fb93a5-5978-45e9-ac51-ed55151540e0 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:18 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-65fb93a5-5978-45e9-ac51-ed55151540e0 Jul 03 01:20:18 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Flow 'volume_create_manager' (2b4433bb-13f3-4313-b379-a5807a9aed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cece91-80d8-4e71-80ee-649a947c7012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cece91-80d8-4e71-80ee-649a947c7012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d211d5-d840-4821-9fc5-c1b851315a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84349e4d68ba498da74e9c360b00de64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:18Z,use_quota=True,user_id='0c29c02aaf034c239fe9c33a19869f38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521e0ebc-4d03-481c-901f-2edaff14af28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521e0ebc-4d03-481c-901f-2edaff14af28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fbc6694-936d-404f-9d4a-9fc4ca5b5ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fbc6694-936d-404f-9d4a-9fc4ca5b5ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83d211d5-d840-4821-9fc5-c1b851315a7f', 'volume_name': 'volume-83d211d5-d840-4821-9fc5-c1b851315a7f', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555d5dcc-1830-417b-9201-81af392cb056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555d5dcc-1830-417b-9201-81af392cb056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079bce33-be29-4669-be73-24f802c14abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:18 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Volume 83d211d5-d840-4821-9fc5-c1b851315a7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83d211d5-d840-4821-9fc5-c1b851315a7f', 'volume_size': 1} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d211d5-d840-4821-9fc5-c1b851315a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84349e4d68ba498da74e9c360b00de64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:18Z,use_quota=True,user_id='0c29c02aaf034c239fe9c33a19869f38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Creating volume 83d211d5-d840-4821-9fc5-c1b851315a7f {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:18 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83d211d5-d840-4821-9fc5-c1b851315a7f 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:18 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83d211d5-d840-4821-9fc5-c1b851315a7f 1073741824 Jul 03 01:20:18 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:18 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a" returned: 1 in 1.022s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:18 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a Jul 03 01:20:18 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:18 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-65fb93a5-5978-45e9-ac51-ed55151540e0" returned: 0 in 0.882s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-65fb93a5-5978-45e9-ac51-ed55151540e0" released by "delete_volume" :: held 2.224s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Created reservations ['d5a4d949-0523-47ca-a3fa-24e35e3c971c', '22afda15-8f9e-47c9-9e34-a358c18d6943', '91257d19-5d83-4eb8-8749-323ea648ceeb', '02b57032-2d1c-4418-a763-9c9510722d08'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:19 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:20:19 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:19 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83d211d5-d840-4821-9fc5-c1b851315a7f 1073741824" returned: 0 in 1.059s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83d211d5-d840-4821-9fc5-c1b851315a7f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:19 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-bfc09dcf-3dc5-48ed-906b-5980814a426a" returned: 0 in 0.957s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:19 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83d211d5-d840-4821-9fc5-c1b851315a7f Jul 03 01:20:19 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Lock "cinder-quobyte-bfc09dcf-3dc5-48ed-906b-5980814a426a" released by "delete_volume" :: held 3.418s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Created reservations ['e5f209f3-f484-4b4d-8160-cfe1010f047e', 'ac5edd26-7df4-4dfb-b84b-315d81e3d571', 'c213267f-1d3f-45d2-861c-d12a8cc15e1a', '72b8c2a6-6013-4e4a-8936-461cc566de1e'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:19 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:20:19 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:20 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.940s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-4ed6354f-9421-44a6-8e7a-c12737ab7053-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:20 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Deleted volume successfully. Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-4ed6354f-9421-44a6-8e7a-c12737ab7053-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-quobyte-cc169bc9-4e6b-4833-99c8-33b6140c1f60" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-cc169bc9-4e6b-4833-99c8-33b6140c1f60" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-quobyte-4ed6354f-9421-44a6-8e7a-c12737ab7053" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5bfb949a-9a30-4543-9c90-3154ee987f68 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-65fb93a5-5978-45e9-ac51-ed55151540e0-delete_volume" released by "delete_volume" :: held 3.526s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-4ed6354f-9421-44a6-8e7a-c12737ab7053" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Deleting offline snapshot 4ed6354f-9421-44a6-8e7a-c12737ab7053 of volume cc169bc9-4e6b-4833-99c8-33b6140c1f60 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] snapshot_file for this snap is: volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[4134571f-08ac-4f39-b8f5-c8ef60160847]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:20 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 Jul 03 01:20:20 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:20 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83d211d5-d840-4821-9fc5-c1b851315a7f" returned: 0 in 0.925s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079bce33-be29-4669-be73-24f802c14abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d211d5-d840-4821-9fc5-c1b851315a7f', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7ef55f-6177-410d-b112-152c878d07fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:20 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Volume volume-83d211d5-d840-4821-9fc5-c1b851315a7f (83d211d5-d840-4821-9fc5-c1b851315a7f): created successfully Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7ef55f-6177-410d-b112-152c878d07fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Flow 'volume_create_manager' (2b4433bb-13f3-4313-b379-a5807a9aed7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:20 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-55f81ff9-c873-4851-a7da-286a03ae6cee tempest-VolumesListAdminTestJSON-1691867800 None] Created volume successfully. Jul 03 01:20:20 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.942s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:20 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Deleted volume successfully. Jul 03 01:20:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d6a6bf67-ef74-419a-ace6-4d88b0c61dbe tempest-VolumeImageDependencyTests-1603391942 None] Lock "cinder-bfc09dcf-3dc5-48ed-906b-5980814a426a-delete_volume" released by "delete_volume" :: held 4.624s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:21 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053" returned: 0 in 0.911s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:20:21 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3782d6c1-bf30-4e6d-a5a5-e07e42df2d18]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:21 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 Jul 03 01:20:21 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Acquiring lock "cinder-83d211d5-d840-4821-9fc5-c1b851315a7f-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Lock "cinder-83d211d5-d840-4821-9fc5-c1b851315a7f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Acquiring lock "cinder-quobyte-83d211d5-d840-4821-9fc5-c1b851315a7f" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Lock "cinder-quobyte-83d211d5-d840-4821-9fc5-c1b851315a7f" acquired by "delete_volume" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:21 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[4566cfe7-583c-4d45-99fe-ee8e16ef2ff8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83d211d5-d840-4821-9fc5-c1b851315a7f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "cinder-d9f53020-87fb-46f3-a9e8-bab0544ff3ac-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:22 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83d211d5-d840-4821-9fc5-c1b851315a7f Jul 03 01:20:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Lock "cinder-d9f53020-87fb-46f3-a9e8-bab0544ff3ac-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:22 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "cinder-quobyte-d9f53020-87fb-46f3-a9e8-bab0544ff3ac" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Lock "cinder-quobyte-d9f53020-87fb-46f3-a9e8-bab0544ff3ac" acquired by "delete_volume" :: waited 0.033s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:22 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[39eb1f85-92ca-4a17-b554-982dc9488fd3]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:22 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60" returned: 0 in 1.181s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:22 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac Jul 03 01:20:22 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:22 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 Jul 03 01:20:22 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:23 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83d211d5-d840-4821-9fc5-c1b851315a7f" returned: 0 in 1.424s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83d211d5-d840-4821-9fc5-c1b851315a7f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:23 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83d211d5-d840-4821-9fc5-c1b851315a7f Jul 03 01:20:23 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:23 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac" returned: 0 in 1.230s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:23 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053" returned: 0 in 1.139s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:23 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac Jul 03 01:20:23 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:23 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053 Jul 03 01:20:23 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:24 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83d211d5-d840-4821-9fc5-c1b851315a7f" returned: 0 in 0.844s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Lock "cinder-quobyte-83d211d5-d840-4821-9fc5-c1b851315a7f" released by "delete_volume" :: held 2.331s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Created reservations ['8c91158f-9c7c-4427-a6f3-3724a30f087d', '34c8f0b7-5fca-4477-ae18-009148dde329', 'c736da97-4f98-4fcf-9082-254d561e3265', 'e4bd97b4-274b-4612-8124-7f10539560bc'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:24 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d9f53020-87fb-46f3-a9e8-bab0544ff3ac" returned: 0 in 0.927s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:24 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:20:24 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Lock "cinder-quobyte-d9f53020-87fb-46f3-a9e8-bab0544ff3ac" released by "delete_volume" :: held 2.251s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Created reservations ['9bba53b6-dedc-42b2-9f66-dbbc8278166b', 'aecc652a-0aef-4b39-8d98-8c3a728d5855', '29bfab8c-dd5c-45e3-aa41-565215c80057', '97c6e640-6407-4468-bddc-971089d05015'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:24 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60.4ed6354f-9421-44a6-8e7a-c12737ab7053" returned: 0 in 1.120s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:24 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:20:24 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-4ed6354f-9421-44a6-8e7a-c12737ab7053" released by "_delete_snapshot" :: held 4.525s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-cc169bc9-4e6b-4833-99c8-33b6140c1f60" released by "delete_snapshot" :: held 4.563s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:24 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Created reservations ['c906461d-85f4-4604-9e6d-ca9cdb456de9', 'e0013b87-6913-40de-b659-9c15ef94c39d', '4551570e-19ad-4a69-9f98-08169f3d5186', 'b7940403-f0eb-4ada-9511-693aefc3dd02'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Delete snapshot completed successfully. Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7ea70ae9-6c8b-41cc-b9e9-649d1f1740a5 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-4ed6354f-9421-44a6-8e7a-c12737ab7053-delete_snapshot" released by "delete_snapshot" :: held 4.849s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:25 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.013s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Deleted volume successfully. Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3da1be5b-b1c5-493c-bccf-df786f5b21f1 tempest-VolumesListAdminTestJSON-1691867800 None] Lock "cinder-83d211d5-d840-4821-9fc5-c1b851315a7f-delete_volume" released by "delete_volume" :: held 3.696s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-cc169bc9-4e6b-4833-99c8-33b6140c1f60-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-cc169bc9-4e6b-4833-99c8-33b6140c1f60-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "cinder-quobyte-cc169bc9-4e6b-4833-99c8-33b6140c1f60" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-cc169bc9-4e6b-4833-99c8-33b6140c1f60" acquired by "delete_volume" :: waited 0.034s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[1179b2c0-4ae3-455d-80b6-8e711df130df]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "cinder-ed47813d-b839-4338-a3b5-fb7b3ee00204-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Lock "cinder-ed47813d-b839-4338-a3b5-fb7b3ee00204-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "cinder-quobyte-ed47813d-b839-4338-a3b5-fb7b3ee00204" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Lock "cinder-quobyte-ed47813d-b839-4338-a3b5-fb7b3ee00204" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb987ce-0072-4efa-aaf9-23cd4b4d2412]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ed47813d-b839-4338-a3b5-fb7b3ee00204 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:25 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 Jul 03 01:20:26 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:26 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:26 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ed47813d-b839-4338-a3b5-fb7b3ee00204 Jul 03 01:20:26 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.474s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:26 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:26 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Deleted volume successfully. Jul 03 01:20:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fe44b556-4bc3-48fe-ae86-68c86e1342ac tempest-VolumesListAdminTestJSON-1942238397 None] Lock "cinder-d9f53020-87fb-46f3-a9e8-bab0544ff3ac-delete_volume" released by "delete_volume" :: held 4.054s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:27 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60" returned: 0 in 1.311s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:27 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60 Jul 03 01:20:27 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:27 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ed47813d-b839-4338-a3b5-fb7b3ee00204" returned: 0 in 1.411s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ed47813d-b839-4338-a3b5-fb7b3ee00204 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:27 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ed47813d-b839-4338-a3b5-fb7b3ee00204 Jul 03 01:20:27 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:20:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:27 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:20:27 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:27 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cc169bc9-4e6b-4833-99c8-33b6140c1f60" returned: 0 in 0.886s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:28 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-quobyte-cc169bc9-4e6b-4833-99c8-33b6140c1f60" released by "delete_volume" :: held 2.321s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:28 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Created reservations ['555bbd31-d138-4039-9bbf-0aceef3f4efa', 'f444ccab-f473-4597-9ec0-240e8beaa3a3', '17da4646-8b6a-4840-9fcf-5c9dc158e044', '024de687-6839-43fc-bf68-d7ae4dfd7200'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:28 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:20:28 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:29 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ed47813d-b839-4338-a3b5-fb7b3ee00204" returned: 0 in 1.709s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:29 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.287s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Lock "cinder-quobyte-ed47813d-b839-4338-a3b5-fb7b3ee00204" released by "delete_volume" :: held 3.210s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Created reservations ['2b98cbc3-4ab6-4172-ba85-b8a781b0604e', '15f543d5-fc4f-448a-bae5-8d4037304f7b', '22f58c2c-c952-4f28-be2d-564061c5727a', '42b1576a-0d1d-425e-bea6-42fc6181b6f7'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:29 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:20:29 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:29 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.156s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:29 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Deleted volume successfully. Jul 03 01:20:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-64ba10d6-ded7-4f50-b960-3e209046be67 tempest-CreateVolumesFromSnapshotTest-1599383814 None] Lock "cinder-cc169bc9-4e6b-4833-99c8-33b6140c1f60-delete_volume" released by "delete_volume" :: held 4.004s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:30 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.959s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:30 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:30 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Deleted volume successfully. Jul 03 01:20:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a3c7ac67-8454-4173-9c92-0c52cda99899 tempest-VolumesListAdminTestJSON-1942238397 None] Lock "cinder-ed47813d-b839-4338-a3b5-fb7b3ee00204-delete_volume" released by "delete_volume" :: held 4.555s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "cinder-8ae30f0b-f50f-4033-80c0-ad450cb41ce2-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Lock "cinder-8ae30f0b-f50f-4033-80c0-ad450cb41ce2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "cinder-quobyte-8ae30f0b-f50f-4033-80c0-ad450cb41ce2" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Lock "cinder-quobyte-8ae30f0b-f50f-4033-80c0-ad450cb41ce2" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:30 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[024fbfbd-3bc8-4022-b989-75b2bd8ee8ef]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:30 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2 Jul 03 01:20:30 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:31 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2" returned: 0 in 0.986s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:31 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2 Jul 03 01:20:31 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:32 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8ae30f0b-f50f-4033-80c0-ad450cb41ce2" returned: 0 in 0.927s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Lock "cinder-quobyte-8ae30f0b-f50f-4033-80c0-ad450cb41ce2" released by "delete_volume" :: held 1.969s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:32 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Created reservations ['65d75247-907d-4912-bd21-8fbc846c8152', 'a03f6e44-0962-498d-bc1f-292b49021041', '13b1c0d7-90e8-4704-a14f-641ef1054161', 'cda1637e-5db8-4ba9-89a9-e53c7ec22ebe'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:32 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:20:32 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:33 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.707s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:33 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:33 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Deleted volume successfully. Jul 03 01:20:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0cf4364a-68ef-43d6-9edb-5afcd9dc5acf tempest-VolumesListAdminTestJSON-1942238397 None] Lock "cinder-8ae30f0b-f50f-4033-80c0-ad450cb41ce2-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Flow 'volume_create_manager' (a0067d74-499c-4b0f-9932-4bfcd07df381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df50a6fa-d728-4f15-9e7f-78c7f89b2321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df50a6fa-d728-4f15-9e7f-78c7f89b2321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-295263507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06815290-81b0-4029-8bdd-03a0eda58f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd066f97050470f8b7624e8192a8d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:35Z,use_quota=True,user_id='7506757a1ea04c72afdd64ac41f3f69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d798a70d-9941-4291-862e-3fac452407fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d798a70d-9941-4291-862e-3fac452407fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a16ccd0-33a8-44bb-8ef8-35fde81329a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a16ccd0-33a8-44bb-8ef8-35fde81329a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06815290-81b0-4029-8bdd-03a0eda58f1b', 'volume_name': 'volume-06815290-81b0-4029-8bdd-03a0eda58f1b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8628e5-896b-431f-94ac-d361a73459e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8628e5-896b-431f-94ac-d361a73459e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbbdc99-1762-4849-920b-fa87bef92a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:35 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Volume 06815290-81b0-4029-8bdd-03a0eda58f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06815290-81b0-4029-8bdd-03a0eda58f1b', 'volume_size': 1} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-295263507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06815290-81b0-4029-8bdd-03a0eda58f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd066f97050470f8b7624e8192a8d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:35Z,use_quota=True,user_id='7506757a1ea04c72afdd64ac41f3f69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Creating volume 06815290-81b0-4029-8bdd-03a0eda58f1b {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:35 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:20:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:35 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b 1073741824 Jul 03 01:20:35 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:36 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b 1073741824" returned: 0 in 0.961s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:36 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b Jul 03 01:20:36 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:37 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b" returned: 0 in 0.774s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbbdc99-1762-4849-920b-fa87bef92a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06815290-81b0-4029-8bdd-03a0eda58f1b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a98ac3c-d385-42c9-a2e3-2544cfa028ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:37 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Volume volume-06815290-81b0-4029-8bdd-03a0eda58f1b (06815290-81b0-4029-8bdd-03a0eda58f1b): created successfully Jul 03 01:20:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a98ac3c-d385-42c9-a2e3-2544cfa028ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Flow 'volume_create_manager' (a0067d74-499c-4b0f-9932-4bfcd07df381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:37 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7b7ee4b2-bb05-49d2-bb9f-cc6f3b7060dc tempest-VolumeDependencyTests-280655155 None] Created volume successfully. Jul 03 01:20:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] Creating offline snapshot 71e85890-4501-4f3c-b20d-6a2a6ac0ed8f of volume 06815290-81b0-4029-8bdd-03a0eda58f1b {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:20:38 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d535ee39-3afa-4086-aa3e-da76d8659d23]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:39 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b Jul 03 01:20:39 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:39 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Flow 'volume_create_manager' (8feb4a2c-7f7d-4dfa-840d-47401661e5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c596a78-917a-4337-908e-ef6879519f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c596a78-917a-4337-908e-ef6879519f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1957471892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ac86d3-57c0-47fe-bfaf-067e064e3c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1807264696764a63ab466a488e0419a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:40Z,use_quota=True,user_id='d561c716ac544841bac3b2ffb6791980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0045ab04-c8ee-403d-b3e6-9cd2bfa70c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0045ab04-c8ee-403d-b3e6-9cd2bfa70c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1e0c63-1cad-4f1f-b0a0-25be80dd66ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:39 devstack cinder-volume[86357]: DEBUG cinder.image.glance [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Creating Keystone auth plugin from conf {{(pid=86357) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:20:40 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b" returned: 0 in 1.235s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:40 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f 1G Jul 03 01:20:40 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1e0c63-1cad-4f1f-b0a0-25be80dd66ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e8ac86d3-57c0-47fe-bfaf-067e064e3c41', 'volume_name': 'volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41', 'volume_size': 1, 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7645134c6d614f2bac5348098ce26f25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'created_at': datetime.datetime(2026, 7, 2, 22, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ec2b61-75e9-451f-a4fa-d3f475403447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ec2b61-75e9-451f-a4fa-d3f475403447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12ce788-73dd-4657-9547-b482b5aca746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:40 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Volume e8ac86d3-57c0-47fe-bfaf-067e064e3c41: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41', 'volume_size': 1, 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7645134c6d614f2bac5348098ce26f25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'created_at': datetime.datetime(2026, 7, 2, 22, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 01:20:40 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Trying to clone e8ac86d3-57c0-47fe-bfaf-067e064e3c41 from image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]). {{(pid=86357) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:20:41 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:20:41 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Image download 20.69 MB at 20.69 MB/s Jul 03 01:20:41 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[acef3fdc-a910-479e-a54a-6a3212ebb7cc]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:41 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD Jul 03 01:20:41 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:41 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f 1G" returned: 0 in 1.206s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06815290-81b0-4029-8bdd-03a0eda58f1b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:41 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06815290-81b0-4029-8bdd-03a0eda58f1b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f Jul 03 01:20:41 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:42 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD" returned: 0 in 1.050s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:42 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Temporary image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd is fetched for user d561c716ac544841bac3b2ffb6791980. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:20:42 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f78cc5-cad1-4678-addd-c77adb07a8d2]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:42 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD Jul 03 01:20:42 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:42 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06815290-81b0-4029-8bdd-03a0eda58f1b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f" returned: 0 in 1.118s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:42 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f is being set with open permissions: ugo+rw Jul 03 01:20:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:42 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f Jul 03 01:20:42 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:43 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD" returned: 0 in 0.956s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:43 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f" returned: 0 in 0.970s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:43 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.info Jul 03 01:20:43 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:44 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.info" returned: 0 in 1.019s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:44 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.info is being set with open permissions: ugo+rw Jul 03 01:20:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:44 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.info Jul 03 01:20:44 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:44 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Flow 'volume_create_manager' (2407143c-ee23-4589-bf5a-81886982fe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a1a2ba-893c-4763-98e8-2965d0be8883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a1a2ba-893c-4763-98e8-2965d0be8883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1891716731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6ecebfb175e458897a68b841dd7d74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:45Z,use_quota=True,user_id='6c3da51664cf4417a1f7241520e89aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73a13dc-4f55-41b0-a86c-e68ff58da39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73a13dc-4f55-41b0-a86c-e68ff58da39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbf46e0-4198-40d6-9b0b-6fff63e61821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbf46e0-4198-40d6-9b0b-6fff63e61821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a', 'volume_name': 'volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ed96e1-e6c1-4138-9d75-9dbe44a59ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ed96e1-e6c1-4138-9d75-9dbe44a59ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66304ff0-f3b3-4ea4-9ac3-42078a7c6b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:45 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Volume a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a', 'volume_size': 1} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:45 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.info" returned: 0 in 0.761s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.504s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.105s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1957471892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ac86d3-57c0-47fe-bfaf-067e064e3c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1807264696764a63ab466a488e0419a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:40Z,use_quota=True,user_id='d561c716ac544841bac3b2ffb6791980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Creating volume e8ac86d3-57c0-47fe-bfaf-067e064e3c41 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:45 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:20:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:45 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 1073741824 Jul 03 01:20:45 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:45 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-45ada5a6-656c-42ef-88a1-51f77fd35510 tempest-VolumeDependencyTests-280655155 None] Create snapshot completed successfully Jul 03 01:20:46 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 1073741824" returned: 0 in 0.957s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:46 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 Jul 03 01:20:46 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:46 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Flow 'volume_create_manager' (398fb4cd-69c5-4f26-8d89-3f598096d803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecb5df0-30a9-4b27-9d47-21c65fe5ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecb5df0-30a9-4b27-9d47-21c65fe5ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1173356396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e263dd6-d9b4-42a5-898b-7ea9949a6515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd066f97050470f8b7624e8192a8d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=71e85890-4501-4f3c-b20d-6a2a6ac0ed8f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:47Z,use_quota=True,user_id='7506757a1ea04c72afdd64ac41f3f69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc61085b-082f-45f3-90ef-d76eb8299e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc61085b-082f-45f3-90ef-d76eb8299e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d1e839-bf19-4e02-90b0-04d245f0d72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d1e839-bf19-4e02-90b0-04d245f0d72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e263dd6-d9b4-42a5-898b-7ea9949a6515', 'volume_name': 'volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515', 'volume_size': 1, 'snapshot_id': '71e85890-4501-4f3c-b20d-6a2a6ac0ed8f'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c520ec-d440-4ffc-8080-ee5bd71a375b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c520ec-d440-4ffc-8080-ee5bd71a375b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e754803-33d1-4596-b4ad-0ef315603c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:47 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Volume 0e263dd6-d9b4-42a5-898b-7ea9949a6515: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515', 'volume_size': 1, 'snapshot_id': '71e85890-4501-4f3c-b20d-6a2a6ac0ed8f'} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:47 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" returned: 0 in 0.907s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.192s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1891716731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6ecebfb175e458897a68b841dd7d74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:45Z,use_quota=True,user_id='6c3da51664cf4417a1f7241520e89aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Creating volume a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:47 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:47 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a 1073741824 Jul 03 01:20:47 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Attempting download of 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd ((None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}])) to volume e8ac86d3-57c0-47fe-bfaf-067e064e3c41. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10e6190-265d-490f-92ae-0611ac4a8291]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_91dt6bbl {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:47 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_91dt6bbl Jul 03 01:20:47 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:48 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_91dt6bbl" returned: 0 in 0.864s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_91dt6bbl {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:48 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a 1073741824" returned: 0 in 1.048s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:48 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a Jul 03 01:20:48 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:48 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_91dt6bbl Jul 03 01:20:48 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:49 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a" returned: 0 in 0.698s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.925s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Acquiring lock "cinder-quobyte-71e85890-4501-4f3c-b20d-6a2a6ac0ed8f-0e263dd6-d9b4-42a5-898b-7ea9949a6515" by "_create_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66304ff0-f3b3-4ea4-9ac3-42078a7c6b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4e8006-d3ba-427c-8d27-f7fd525fefae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Lock "cinder-quobyte-71e85890-4501-4f3c-b20d-6a2a6ac0ed8f-0e263dd6-d9b4-42a5-898b-7ea9949a6515" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Creating volume 0e263dd6-d9b4-42a5-898b-7ea9949a6515 from snapshot 71e85890-4501-4f3c-b20d-6a2a6ac0ed8f {{(pid=86357) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Acquiring lock "cinder-quobyte-0e263dd6-d9b4-42a5-898b-7ea9949a6515" by "_copy_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:49 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Volume volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a (a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a): created successfully Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4e8006-d3ba-427c-8d27-f7fd525fefae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Flow 'volume_create_manager' (2407143c-ee23-4589-bf5a-81886982fe03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Lock "cinder-quobyte-0e263dd6-d9b4-42a5-898b-7ea9949a6515" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] snapshot: 71e85890-4501-4f3c-b20d-6a2a6ac0ed8f, volume: 0e263dd6-d9b4-42a5-898b-7ea9949a6515, {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:20:49 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-51453b71-3231-4d8e-ba20-bf46b2df18b9 tempest-VolumesTransfersTest-832928070 None] Created volume successfully. Jul 03 01:20:49 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_91dt6bbl" returned: 1 in 0.981s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_91dt6bbl' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdb9a13-feb6-474b-afc4-2190d2627690]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f45ae7-1b43-4acd-8311-b672c1f04b6b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:49 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD Jul 03 01:20:49 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:49 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f Jul 03 01:20:49 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:50 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD" returned: 0 in 0.985s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:50 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd was qcow2, converting to raw {{(pid=86357) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:20:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:50 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 Jul 03 01:20:50 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:50 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f" returned: 0 in 1.023s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:50 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06815290-81b0-4029-8bdd-03a0eda58f1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:20:50 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:20:50 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Creating direct copy from snapshot {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:20:50 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aebe2c-2ee1-4fd7-9734-f8cc6b8b5719]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:50 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-854efe57-73d5-4238-af17-130e3766a846 tempest-VolumesTransfersTest-1693464411 None] Transfer volume completed successfully. Jul 03 01:20:50 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b Jul 03 01:20:50 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:51 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b" returned: 0 in 0.931s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:51 devstack cinder-volume[86357]: DEBUG cinder.utils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Path /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515 not found in is_blk_device check {{(pid=86357) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:20:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:51 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515 Jul 03 01:20:51 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Acquiring lock "cinder-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Lock "cinder-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Acquiring lock "cinder-quobyte-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Lock "cinder-quobyte-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:51 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfb1841-232b-4ac4-8a3d-3a7b65bdc4af]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:51 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a Jul 03 01:20:51 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:53 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a" returned: 0 in 1.635s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:53 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a Jul 03 01:20:53 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:53 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" returned: 0 in 3.169s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:53 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_jh2uacl5devstack@QuobyteHD, size 112.00 MB, duration 3.18 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:20:53 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Converted 112.00 MB image at 35.26 MB/s Jul 03 01:20:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:53 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 1G Jul 03 01:20:53 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:55 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a" returned: 0 in 2.095s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Lock "cinder-quobyte-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a" released by "delete_volume" :: held 3.795s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=105,cinder:UPDATE=128,cinder:INSERT=38,cinder:DELETE=14 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=109,cinder:UPDATE=165,cinder:DELETE=12,cinder:INSERT=39 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:20:55 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 1G" returned: 0 in 2.110s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Created reservations ['48f40883-2395-41f8-bfaa-0484467092f7', 'f6aec4f1-687f-497b-806f-2d26f88b8950', 'b0b407c4-f6e7-4029-93b7-e67b8197a572', '20b3520f-a536-406c-b29d-cbd74f650fcc'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d0d4ae-7dad-4447-aaf4-54dd1e15e696]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:55 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:20:55 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:55 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 Jul 03 01:20:55 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:57 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.388s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:57 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:57 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Deleted volume successfully. Jul 03 01:20:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c5122280-9433-406a-9b6e-7ccfbb8e57e0 tempest-VolumesTransfersTest-270327097 None] Lock "cinder-a9fb71c7-5cf1-4b8f-923f-0a6d75a36d6a-delete_volume" released by "delete_volume" :: held 5.761s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:57 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" returned: 0 in 2.327s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:58 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 Jul 03 01:20:58 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:58 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515" returned: 0 in 6.961s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a347ba-f4d0-439e-b7d8-d0cc5f13a759]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:58 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b Jul 03 01:20:58 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Flow 'volume_create_manager' (628fe32e-ac0b-4f7e-9006-49e9bb744e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e496995-408a-4367-a6df-38172dd1ed97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e496995-408a-4367-a6df-38172dd1ed97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-290260769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835746f9-5c2b-4614-a76c-12a41679b0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6ecebfb175e458897a68b841dd7d74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:58Z,use_quota=True,user_id='6c3da51664cf4417a1f7241520e89aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e7eb8b-c897-436b-88d2-f1365390771e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e7eb8b-c897-436b-88d2-f1365390771e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c586b3-4163-485d-9ef3-96dfd95dc82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c586b3-4163-485d-9ef3-96dfd95dc82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '835746f9-5c2b-4614-a76c-12a41679b0f3', 'volume_name': 'volume-835746f9-5c2b-4614-a76c-12a41679b0f3', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64fa98d-83b0-4848-9d72-40b414afafb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64fa98d-83b0-4848-9d72-40b414afafb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbaa6398-ad42-436e-9425-6e06662d28cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:58 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Volume 835746f9-5c2b-4614-a76c-12a41679b0f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-835746f9-5c2b-4614-a76c-12a41679b0f3', 'volume_size': 1} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:58 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" returned: 1 in 0.948s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Downloaded image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd ((None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}])) to volume e8ac86d3-57c0-47fe-bfaf-067e064e3c41 successfully. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Temporary image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd for user d561c716ac544841bac3b2ffb6791980 is deleted. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Marking volume e8ac86d3-57c0-47fe-bfaf-067e064e3c41 as bootable. {{(pid=86357) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Copying metadata from image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd to e8ac86d3-57c0-47fe-bfaf-067e064e3c41. {{(pid=86357) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:20:58 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Creating volume glance metadata for volume e8ac86d3-57c0-47fe-bfaf-067e064e3c41 backed by image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86357) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12ce788-73dd-4657-9547-b482b5aca746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41', 'volume_size': 1, 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7645134c6d614f2bac5348098ce26f25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'created_at': datetime.datetime(2026, 7, 2, 22, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa169e85-28fc-47d4-a433-179b5c728b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:59 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Volume volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 (e8ac86d3-57c0-47fe-bfaf-067e064e3c41): created successfully Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa169e85-28fc-47d4-a433-179b5c728b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Flow 'volume_create_manager' (8feb4a2c-7f7d-4dfa-840d-47401661e5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:59 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8762021f-f652-4ac3-a7b0-2f1f2aadc0da tempest-TestShelveInstance-1531294479 None] Created volume successfully. Jul 03 01:20:59 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b" returned: 0 in 1.019s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b, size 1024.00 MB, duration 6.96 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:20:59 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Converted 1024.00 MB image at 147.09 MB/s Jul 03 01:20:59 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515 is being set with open permissions: ugo+rw Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:59 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515 Jul 03 01:20:59 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:59 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515" returned: 0 in 0.676s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Lock "cinder-quobyte-0e263dd6-d9b4-42a5-898b-7ea9949a6515" released by "_copy_volume_from_snapshot" :: held 10.775s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Lock "cinder-quobyte-71e85890-4501-4f3c-b20d-6a2a6ac0ed8f-0e263dd6-d9b4-42a5-898b-7ea9949a6515" released by "_create_volume_from_snapshot" :: held 10.832s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.868s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.510s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-290260769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835746f9-5c2b-4614-a76c-12a41679b0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6ecebfb175e458897a68b841dd7d74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:58Z,use_quota=True,user_id='6c3da51664cf4417a1f7241520e89aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Creating volume 835746f9-5c2b-4614-a76c-12a41679b0f3 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:59 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:20:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-835746f9-5c2b-4614-a76c-12a41679b0f3 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:59 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-835746f9-5c2b-4614-a76c-12a41679b0f3 1073741824 Jul 03 01:20:59 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e754803-33d1-4596-b4ad-0ef315603c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515', 'volume_size': 1, 'snapshot_id': '71e85890-4501-4f3c-b20d-6a2a6ac0ed8f'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d51ba13-a36a-4b68-b20b-f8a30a6f53c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:00 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Volume volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515 (0e263dd6-d9b4-42a5-898b-7ea9949a6515): created successfully Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d51ba13-a36a-4b68-b20b-f8a30a6f53c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Flow 'volume_create_manager' (398fb4cd-69c5-4f26-8d89-3f598096d803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:00 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-979ca713-73c1-4898-9ec1-2872fa7fc727 tempest-VolumeDependencyTests-280655155 None] Created volume successfully. Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Acquiring lock "cinder-71e85890-4501-4f3c-b20d-6a2a6ac0ed8f-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Lock "cinder-71e85890-4501-4f3c-b20d-6a2a6ac0ed8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Acquiring lock "cinder-quobyte-06815290-81b0-4029-8bdd-03a0eda58f1b" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Lock "cinder-quobyte-06815290-81b0-4029-8bdd-03a0eda58f1b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Acquiring lock "cinder-quobyte-71e85890-4501-4f3c-b20d-6a2a6ac0ed8f" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Lock "cinder-quobyte-71e85890-4501-4f3c-b20d-6a2a6ac0ed8f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Deleting offline snapshot 71e85890-4501-4f3c-b20d-6a2a6ac0ed8f of volume 06815290-81b0-4029-8bdd-03a0eda58f1b {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] snapshot_file for this snap is: volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caab1e4-8c99-4978-8694-c2c044a7a3c3]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:00 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f Jul 03 01:21:00 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:01 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-835746f9-5c2b-4614-a76c-12a41679b0f3 1073741824" returned: 0 in 1.128s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-835746f9-5c2b-4614-a76c-12a41679b0f3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:01 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-835746f9-5c2b-4614-a76c-12a41679b0f3 Jul 03 01:21:01 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Flow 'volume_create_manager' (fadba77b-e095-4850-b4ad-8212779f7687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f46623d-543c-4a31-bd84-c7498fbc522a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f46623d-543c-4a31-bd84-c7498fbc522a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-439092191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106a0598-20a8-44eb-b0f1-457952b6f68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9380c0431134ab588d9fcea50ac4c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:01Z,use_quota=True,user_id='2d32a51ac787429c9543b20fdb2691d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24d794f-b535-49e5-b10e-73b4ca278437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24d794f-b535-49e5-b10e-73b4ca278437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3221c3-781c-465b-ac08-d3067e4e4068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3221c3-781c-465b-ac08-d3067e4e4068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106a0598-20a8-44eb-b0f1-457952b6f68d', 'volume_name': 'volume-106a0598-20a8-44eb-b0f1-457952b6f68d', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1c237f-3bcb-4750-acc7-1731eda79c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1c237f-3bcb-4750-acc7-1731eda79c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:01 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce6f453-f406-41ba-9620-d5a6ecc1f456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:01 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Volume 106a0598-20a8-44eb-b0f1-457952b6f68d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106a0598-20a8-44eb-b0f1-457952b6f68d', 'volume_size': 1} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f" returned: 0 in 0.957s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06815290-81b0-4029-8bdd-03a0eda58f1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a900c7-f180-4faf-b282-8f55ad1ac1a8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:01 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b Jul 03 01:21:01 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:02 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-835746f9-5c2b-4614-a76c-12a41679b0f3" returned: 0 in 1.137s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.328s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.614s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-439092191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106a0598-20a8-44eb-b0f1-457952b6f68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9380c0431134ab588d9fcea50ac4c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:01Z,use_quota=True,user_id='2d32a51ac787429c9543b20fdb2691d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Creating volume 106a0598-20a8-44eb-b0f1-457952b6f68d {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:21:02 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbaa6398-ad42-436e-9425-6e06662d28cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835746f9-5c2b-4614-a76c-12a41679b0f3', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdac343-10c3-4a0c-8877-c0e838601964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:02 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d 1073741824 Jul 03 01:21:02 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:02 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Volume volume-835746f9-5c2b-4614-a76c-12a41679b0f3 (835746f9-5c2b-4614-a76c-12a41679b0f3): created successfully Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdac343-10c3-4a0c-8877-c0e838601964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Flow 'volume_create_manager' (628fe32e-ac0b-4f7e-9006-49e9bb744e3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:02 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-5ea4333d-cbe8-4814-be88-e072c42d7462 tempest-VolumesTransfersTest-832928070 None] Created volume successfully. Jul 03 01:21:02 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b" returned: 0 in 0.946s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:02 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f Jul 03 01:21:02 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Acquiring lock "cinder-835746f9-5c2b-4614-a76c-12a41679b0f3-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Lock "cinder-835746f9-5c2b-4614-a76c-12a41679b0f3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Acquiring lock "cinder-quobyte-835746f9-5c2b-4614-a76c-12a41679b0f3" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Lock "cinder-quobyte-835746f9-5c2b-4614-a76c-12a41679b0f3" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:03 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffc4ef9-6091-4dc9-ad3e-9352d52873de]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-835746f9-5c2b-4614-a76c-12a41679b0f3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:03 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-835746f9-5c2b-4614-a76c-12a41679b0f3 Jul 03 01:21:03 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:03 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d 1073741824" returned: 0 in 1.100s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:03 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d Jul 03 01:21:03 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:03 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f" returned: 0 in 0.844s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:03 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f Jul 03 01:21:03 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:03 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-835746f9-5c2b-4614-a76c-12a41679b0f3" returned: 0 in 0.802s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-835746f9-5c2b-4614-a76c-12a41679b0f3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:04 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-835746f9-5c2b-4614-a76c-12a41679b0f3 Jul 03 01:21:04 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:04 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d" returned: 0 in 0.731s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:04 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce6f453-f406-41ba-9620-d5a6ecc1f456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106a0598-20a8-44eb-b0f1-457952b6f68d', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c154b7e-ea36-4460-922c-4ed281fb8d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b.71e85890-4501-4f3c-b20d-6a2a6ac0ed8f" returned: 0 in 0.716s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:04 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Volume volume-106a0598-20a8-44eb-b0f1-457952b6f68d (106a0598-20a8-44eb-b0f1-457952b6f68d): created successfully Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c154b7e-ea36-4460-922c-4ed281fb8d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Flow 'volume_create_manager' (fadba77b-e095-4850-b4ad-8212779f7687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Lock "cinder-quobyte-71e85890-4501-4f3c-b20d-6a2a6ac0ed8f" released by "_delete_snapshot" :: held 3.607s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:04 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f185b15f-8f81-4f3a-9a2e-d6f35167f1ba tempest-SnapshotDependencyTests-850421389 None] Created volume successfully. Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Lock "cinder-quobyte-06815290-81b0-4029-8bdd-03a0eda58f1b" released by "delete_snapshot" :: held 3.649s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Created reservations ['2e1fe82a-def8-49bc-812a-e463fae485ce', 'e8568c6c-bfd8-47a2-9386-8d1a62bbb196', '54e66a4e-04a2-440e-beb6-2e9d21112896', 'fee836cf-5865-44e3-b22e-9454f6576b1d'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:04 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Delete snapshot completed successfully. Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6ac6e48b-61ae-4124-8a8a-7e5bc7647b0c tempest-VolumeDependencyTests-280655155 None] Lock "cinder-71e85890-4501-4f3c-b20d-6a2a6ac0ed8f-delete_snapshot" released by "delete_snapshot" :: held 3.817s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:04 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-835746f9-5c2b-4614-a76c-12a41679b0f3" returned: 0 in 0.687s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Lock "cinder-quobyte-835746f9-5c2b-4614-a76c-12a41679b0f3" released by "delete_volume" :: held 1.530s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Created reservations ['fedcb27f-b565-48f8-9126-afd5e3ed375a', '75553ad6-49ce-49dc-a828-2921678c2c75', '29d38a18-abc0-4c4f-9ca6-8289562d729b', '295ef075-0281-4910-946c-e62187f543ca'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:04 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:21:04 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Acquiring lock "cinder-06815290-81b0-4029-8bdd-03a0eda58f1b-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Lock "cinder-06815290-81b0-4029-8bdd-03a0eda58f1b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Acquiring lock "cinder-quobyte-06815290-81b0-4029-8bdd-03a0eda58f1b" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Lock "cinder-quobyte-06815290-81b0-4029-8bdd-03a0eda58f1b" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] Creating offline snapshot 40134306-4fa5-4a08-b7a3-93577f3e5944 of volume 106a0598-20a8-44eb-b0f1-457952b6f68d {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:21:05 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[685fe2c7-2a29-4611-9d2d-0e8cd8292c8a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:05 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f504a11-660d-4c76-96d1-f852ba680a39]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:05 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b Jul 03 01:21:05 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:05 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d Jul 03 01:21:05 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:05 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.847s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:05 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:21:05 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Deleted volume successfully. Jul 03 01:21:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e67c7b77-d0e8-4377-89aa-b529aa779351 tempest-VolumesTransfersTest-270327097 None] Lock "cinder-835746f9-5c2b-4614-a76c-12a41679b0f3-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:06 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b" returned: 0 in 0.975s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:06 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d" returned: 0 in 0.986s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:06 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b Jul 03 01:21:06 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:06 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 1G Jul 03 01:21:06 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:06 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06815290-81b0-4029-8bdd-03a0eda58f1b" returned: 0 in 0.857s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:06 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Lock "cinder-quobyte-06815290-81b0-4029-8bdd-03a0eda58f1b" released by "delete_volume" :: held 1.912s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Created reservations ['1b090cee-b676-48a2-a3ad-978365c2dcbe', 'bea7359a-44ea-4596-a693-f6bd0e273be0', '29328410-a8dc-4e17-bbd2-3701d2f6ab46', 'bf7b6427-7dbc-4bbb-8346-5503affaddcc'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:07 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 1G" returned: 0 in 1.046s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106a0598-20a8-44eb-b0f1-457952b6f68d -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:07 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106a0598-20a8-44eb-b0f1-457952b6f68d -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 Jul 03 01:21:07 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:07 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:21:07 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Acquiring lock "cinder-0e263dd6-d9b4-42a5-898b-7ea9949a6515-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Lock "cinder-0e263dd6-d9b4-42a5-898b-7ea9949a6515-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Acquiring lock "cinder-quobyte-0e263dd6-d9b4-42a5-898b-7ea9949a6515" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Lock "cinder-quobyte-0e263dd6-d9b4-42a5-898b-7ea9949a6515" acquired by "delete_volume" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ed959c-2634-4328-9ba3-730527d14185]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:07 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515 Jul 03 01:21:07 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.219s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:08 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:08 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:21:08 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Deleted volume successfully. Jul 03 01:21:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-9f2e4052-e448-4d42-ba5e-b3dfd331e904 req-87e148e2-e772-4054-93fa-23cfb1f6ef18 tempest-TestShelveInstance-1531294479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5061e7ee-dd67-457a-8602-8d477de82fee tempest-VolumeDependencyTests-280655155 None] Lock "cinder-06815290-81b0-4029-8bdd-03a0eda58f1b-delete_volume" released by "delete_volume" :: held 3.562s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:08 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106a0598-20a8-44eb-b0f1-457952b6f68d -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944" returned: 0 in 1.388s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:08 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 is being set with open permissions: ugo+rw Jul 03 01:21:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:08 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 Jul 03 01:21:08 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:08 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515" returned: 0 in 1.518s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:09 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515 Jul 03 01:21:09 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:09 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944" returned: 0 in 0.885s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:09 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.info Jul 03 01:21:09 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:10 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0e263dd6-d9b4-42a5-898b-7ea9949a6515" returned: 0 in 1.068s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Lock "cinder-quobyte-0e263dd6-d9b4-42a5-898b-7ea9949a6515" released by "delete_volume" :: held 2.652s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:10 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Created reservations ['70405793-dbd7-4ded-a8d6-d988ed95ec9e', '5aca8f48-4fc2-44bf-99b6-38cc6f8ba312', 'b1e86c6c-68d9-4f43-9ff2-576bad6ded46', '934d5c4f-3b37-49ea-b83e-67f7af8e8334'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:10 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:21:10 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:10 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.info" returned: 0 in 0.921s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:10 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.info is being set with open permissions: ugo+rw Jul 03 01:21:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:10 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.info Jul 03 01:21:10 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:11 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.917s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:11 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:21:11 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Deleted volume successfully. Jul 03 01:21:11 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.info" returned: 0 in 0.772s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.165s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:11 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-026e5a59-1820-4615-a089-5b17dcb72e62 tempest-VolumeDependencyTests-280655155 None] Lock "cinder-0e263dd6-d9b4-42a5-898b-7ea9949a6515-delete_volume" released by "delete_volume" :: held 3.912s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-9f2e4052-e448-4d42-ba5e-b3dfd331e904 req-87e148e2-e772-4054-93fa-23cfb1f6ef18 tempest-TestShelveInstance-1531294479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.691s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:11 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-df7267fb-0c04-4624-9f04-46bd1d56a595 tempest-SnapshotDependencyTests-850421389 None] Create snapshot completed successfully Jul 03 01:21:11 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[17df1bd5-c887-4adb-b602-c85aa260c161]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-9f2e4052-e448-4d42-ba5e-b3dfd331e904 req-87e148e2-e772-4054-93fa-23cfb1f6ef18 tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:11 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 Jul 03 01:21:11 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Flow 'volume_create_manager' (2c3754a9-b098-4cdd-9624-9569198fde96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae42992-b9c2-49db-9109-69f674f1f18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae42992-b9c2-49db-9109-69f674f1f18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c28e70-5a13-4916-9b40-b6b454824a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9380c0431134ab588d9fcea50ac4c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=40134306-4fa5-4a08-b7a3-93577f3e5944,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:12Z,use_quota=True,user_id='2d32a51ac787429c9543b20fdb2691d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c60e55-b815-454b-82e9-0258c3217ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c60e55-b815-454b-82e9-0258c3217ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ec1783-2e4d-4c15-bf4d-7a35fe795918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ec1783-2e4d-4c15-bf4d-7a35fe795918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60c28e70-5a13-4916-9b40-b6b454824a10', 'volume_name': 'volume-60c28e70-5a13-4916-9b40-b6b454824a10', 'volume_size': 1, 'snapshot_id': '40134306-4fa5-4a08-b7a3-93577f3e5944'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67d6b9a-0961-4ff3-a226-508f6c9acd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67d6b9a-0961-4ff3-a226-508f6c9acd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697145e7-c572-4873-85e1-9cbcec6b2865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:12 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Volume 60c28e70-5a13-4916-9b40-b6b454824a10: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60c28e70-5a13-4916-9b40-b6b454824a10', 'volume_size': 1, 'snapshot_id': '40134306-4fa5-4a08-b7a3-93577f3e5944'} Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:12 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-9f2e4052-e448-4d42-ba5e-b3dfd331e904 req-87e148e2-e772-4054-93fa-23cfb1f6ef18 tempest-TestShelveInstance-1531294479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" returned: 0 in 1.174s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-9f2e4052-e448-4d42-ba5e-b3dfd331e904 req-87e148e2-e772-4054-93fa-23cfb1f6ef18 tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:12 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 Jul 03 01:21:12 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:13 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-9f2e4052-e448-4d42-ba5e-b3dfd331e904 req-87e148e2-e772-4054-93fa-23cfb1f6ef18 tempest-TestShelveInstance-1531294479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" returned: 1 in 0.925s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-9f2e4052-e448-4d42-ba5e-b3dfd331e904 req-87e148e2-e772-4054-93fa-23cfb1f6ef18 tempest-TestShelveInstance-1531294479 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-9f2e4052-e448-4d42-ba5e-b3dfd331e904 req-87e148e2-e772-4054-93fa-23cfb1f6ef18 tempest-TestShelveInstance-1531294479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.173s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.945s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "cinder-quobyte-40134306-4fa5-4a08-b7a3-93577f3e5944-60c28e70-5a13-4916-9b40-b6b454824a10" by "_create_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-quobyte-40134306-4fa5-4a08-b7a3-93577f3e5944-60c28e70-5a13-4916-9b40-b6b454824a10" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Creating volume 60c28e70-5a13-4916-9b40-b6b454824a10 from snapshot 40134306-4fa5-4a08-b7a3-93577f3e5944 {{(pid=86357) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "cinder-quobyte-60c28e70-5a13-4916-9b40-b6b454824a10" by "_copy_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-quobyte-60c28e70-5a13-4916-9b40-b6b454824a10" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] snapshot: 40134306-4fa5-4a08-b7a3-93577f3e5944, volume: 60c28e70-5a13-4916-9b40-b6b454824a10, {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-9f2e4052-e448-4d42-ba5e-b3dfd331e904 req-87e148e2-e772-4054-93fa-23cfb1f6ef18 tempest-TestShelveInstance-1531294479 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49634753-28de-4aaa-80f8-a05de4317ef1', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cfdd4c-8aaa-461f-8b32-5de5fd4f2252]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-9f2e4052-e448-4d42-ba5e-b3dfd331e904 req-87e148e2-e772-4054-93fa-23cfb1f6ef18 tempest-TestShelveInstance-1531294479 None] attachment_update completed successfully. Jul 03 01:21:13 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 Jul 03 01:21:13 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:14 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944" returned: 0 in 0.879s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-106a0598-20a8-44eb-b0f1-457952b6f68d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:21:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:21:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Creating direct copy from snapshot {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:21:14 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41db6ba-de96-4b34-a830-d93434deddfc]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:14 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d Jul 03 01:21:14 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:15 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d" returned: 0 in 0.829s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:15 devstack cinder-volume[86357]: DEBUG cinder.utils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Path /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10 not found in is_blk_device check {{(pid=86357) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:21:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:15 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10 Jul 03 01:21:15 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:21 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10" returned: 0 in 6.674s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:21 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ec5d9c-602d-4c98-8170-a034b1f2e1b8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:22 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d Jul 03 01:21:22 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:23 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d" returned: 0 in 1.361s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:23 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:21:23 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Converted 1024.00 MB image at 153.41 MB/s Jul 03 01:21:23 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10 is being set with open permissions: ugo+rw Jul 03 01:21:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:23 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10 Jul 03 01:21:23 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:23 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:INSERT=20,cinder:UPDATE=50,cinder:SELECT=50,cinder:DELETE=3 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:21:23 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=41,cinder:UPDATE=50,cinder:DELETE=6,cinder:INSERT=15 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:21:24 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10" returned: 0 in 0.888s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-quobyte-60c28e70-5a13-4916-9b40-b6b454824a10" released by "_copy_volume_from_snapshot" :: held 10.775s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-quobyte-40134306-4fa5-4a08-b7a3-93577f3e5944-60c28e70-5a13-4916-9b40-b6b454824a10" released by "_create_volume_from_snapshot" :: held 10.831s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.869s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697145e7-c572-4873-85e1-9cbcec6b2865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c28e70-5a13-4916-9b40-b6b454824a10', 'volume_size': 1, 'snapshot_id': '40134306-4fa5-4a08-b7a3-93577f3e5944'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a7d1d3-3e5f-42a9-a478-a5670c118f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:24 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Volume volume-60c28e70-5a13-4916-9b40-b6b454824a10 (60c28e70-5a13-4916-9b40-b6b454824a10): created successfully Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a7d1d3-3e5f-42a9-a478-a5670c118f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Flow 'volume_create_manager' (2c3754a9-b098-4cdd-9624-9569198fde96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:24 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-691d974d-4026-4c43-b945-8d667f065aad tempest-SnapshotDependencyTests-850421389 None] Created volume successfully. Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "cinder-40134306-4fa5-4a08-b7a3-93577f3e5944-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-40134306-4fa5-4a08-b7a3-93577f3e5944-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "cinder-quobyte-106a0598-20a8-44eb-b0f1-457952b6f68d" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-quobyte-106a0598-20a8-44eb-b0f1-457952b6f68d" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "cinder-quobyte-40134306-4fa5-4a08-b7a3-93577f3e5944" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-quobyte-40134306-4fa5-4a08-b7a3-93577f3e5944" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Deleting offline snapshot 40134306-4fa5-4a08-b7a3-93577f3e5944 of volume 106a0598-20a8-44eb-b0f1-457952b6f68d {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] snapshot_file for this snap is: volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c743f7-b0d5-4976-90b8-38c11d0b6d44]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:25 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 Jul 03 01:21:25 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:26 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944" returned: 0 in 1.244s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-106a0598-20a8-44eb-b0f1-457952b6f68d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:21:26 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[735391d5-b2b4-47c9-819b-4e7fb0eb2601]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:26 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d Jul 03 01:21:26 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:27 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d" returned: 0 in 1.171s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:27 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 Jul 03 01:21:27 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:21:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:27 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:21:27 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:28 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944" returned: 0 in 1.097s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:28 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944 Jul 03 01:21:28 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:29 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.670s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:29 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:21:29 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:29 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:21:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:21:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:21:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d.40134306-4fa5-4a08-b7a3-93577f3e5944" returned: 0 in 0.971s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-quobyte-40134306-4fa5-4a08-b7a3-93577f3e5944" released by "_delete_snapshot" :: held 4.649s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-quobyte-106a0598-20a8-44eb-b0f1-457952b6f68d" released by "delete_snapshot" :: held 4.690s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:29 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Created reservations ['4b170a92-57f0-475d-a3bf-e8b87b47f222', 'c10c4a92-2e88-439f-ace8-d462e303c9b7', '22be3ea0-44af-4b32-9ba9-cb32fbf3f738', '58a66e17-3907-47fe-8c57-c286c99fc951'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:29 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Delete snapshot completed successfully. Jul 03 01:21:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0e9c59c7-b420-48e7-80d7-d20bd0d63910 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-40134306-4fa5-4a08-b7a3-93577f3e5944-delete_snapshot" released by "delete_snapshot" :: held 4.929s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Flow 'volume_create_manager' (3d07195b-3438-4468-b8ba-c450b7510b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01635e97-1013-4c36-88ea-70d77d4cea9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01635e97-1013-4c36-88ea-70d77d4cea9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1226475701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ae5c96-860c-4c7b-bf78-edc5fc4e0228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6491e5fb9146e2afaaabeeb7577d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:30Z,use_quota=True,user_id='11a38ec1bb7e4af6979e8e99ff7398eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60c389d-6ad0-462b-8b58-53f2e0de812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60c389d-6ad0-462b-8b58-53f2e0de812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e81670-4c58-4bf1-803b-e852c0e47603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e81670-4c58-4bf1-803b-e852c0e47603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45ae5c96-860c-4c7b-bf78-edc5fc4e0228', 'volume_name': 'volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee3a844-f431-4e8a-b3a4-ef50592afdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee3a844-f431-4e8a-b3a4-ef50592afdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0acfedf-c85b-45be-9581-5a8fac4b6aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:30 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Volume 45ae5c96-860c-4c7b-bf78-edc5fc4e0228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228', 'volume_size': 1} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1226475701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ae5c96-860c-4c7b-bf78-edc5fc4e0228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6491e5fb9146e2afaaabeeb7577d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:30Z,use_quota=True,user_id='11a38ec1bb7e4af6979e8e99ff7398eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Creating volume 45ae5c96-860c-4c7b-bf78-edc5fc4e0228 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:21:30 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:30 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 1073741824 Jul 03 01:21:30 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "cinder-106a0598-20a8-44eb-b0f1-457952b6f68d-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-106a0598-20a8-44eb-b0f1-457952b6f68d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "cinder-quobyte-106a0598-20a8-44eb-b0f1-457952b6f68d" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-quobyte-106a0598-20a8-44eb-b0f1-457952b6f68d" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9021cf83-6550-42ad-8be5-51705c517614]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:30 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d Jul 03 01:21:30 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:31 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 1073741824" returned: 0 in 0.837s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:31 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 Jul 03 01:21:31 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:31 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d" returned: 0 in 0.845s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:31 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d Jul 03 01:21:31 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:31 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" returned: 0 in 0.752s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:21:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0acfedf-c85b-45be-9581-5a8fac4b6aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a81619a-0558-41a3-ba0b-0145a53682aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:31 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Volume volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 (45ae5c96-860c-4c7b-bf78-edc5fc4e0228): created successfully Jul 03 01:21:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a81619a-0558-41a3-ba0b-0145a53682aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Flow 'volume_create_manager' (3d07195b-3438-4468-b8ba-c450b7510b0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:32 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ecf5f802-4905-4a35-94d9-44ee87c35066 tempest-VolumesActionsTest-1241157518 None] Created volume successfully. Jul 03 01:21:32 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-106a0598-20a8-44eb-b0f1-457952b6f68d" returned: 0 in 0.807s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-quobyte-106a0598-20a8-44eb-b0f1-457952b6f68d" released by "delete_volume" :: held 1.719s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:32 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Created reservations ['4f55b909-bf9e-43c0-8cf5-1746327edbc8', '7ec63a27-00e7-473a-ace3-e6ac13a24b4b', 'b7329f2a-ca27-4061-80da-e871f82e7a04', '3e868f01-6477-4a65-884d-9cbd1ca5e0ab'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:32 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:21:32 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "cinder-60c28e70-5a13-4916-9b40-b6b454824a10-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-60c28e70-5a13-4916-9b40-b6b454824a10-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:33 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.727s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:33 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:21:33 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Deleted volume successfully. Jul 03 01:21:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "cinder-quobyte-60c28e70-5a13-4916-9b40-b6b454824a10" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-quobyte-60c28e70-5a13-4916-9b40-b6b454824a10" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-333962d2-fd92-4d97-94b0-4a8e89c305e4 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-106a0598-20a8-44eb-b0f1-457952b6f68d-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:33 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b0dcd0-04c3-4733-9ac0-a0d3b39d76c8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:33 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10 Jul 03 01:21:33 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:33 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10" returned: 0 in 0.795s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:33 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10 Jul 03 01:21:33 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:34 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-60c28e70-5a13-4916-9b40-b6b454824a10" returned: 0 in 0.708s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-quobyte-60c28e70-5a13-4916-9b40-b6b454824a10" released by "delete_volume" :: held 1.548s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:34 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Created reservations ['b55dd882-e7a0-412b-b996-5c3fe4146557', 'd5db148e-1fb6-4e54-8897-01dc0d7ff6cd', '94280928-3a69-44de-8510-bc258a94562f', '642b76ee-5b47-4f86-ae27-a15208fed777'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:34 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:21:34 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:35 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.832s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:35 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:21:35 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Deleted volume successfully. Jul 03 01:21:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-0576d1eb-0835-468d-a283-dfadbf68a0b5 tempest-SnapshotDependencyTests-850421389 None] Lock "cinder-60c28e70-5a13-4916-9b40-b6b454824a10-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:44 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=19,cinder:UPDATE=28,cinder:INSERT=7 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:21:45 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=24,cinder:DELETE=4,cinder:SELECT=17,cinder:INSERT=6 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:21:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c96605b4-171f-4c46-bb14-620c1ad63d69 tempest-VolumesActionsTest-1241157518 None] Acquiring lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" by "attach_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c96605b4-171f-4c46-bb14-620c1ad63d69 tempest-VolumesActionsTest-1241157518 None] Lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" acquired by "attach_volume" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:49 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c96605b4-171f-4c46-bb14-620c1ad63d69 tempest-VolumesActionsTest-1241157518 None] Attaching volume 45ae5c96-860c-4c7b-bf78-edc5fc4e0228 to instance dac4a0fb-0c04-49ac-a9b2-b235310f0f27 at mountpoint /dev/vdb on host None. Jul 03 01:21:49 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c96605b4-171f-4c46-bb14-620c1ad63d69 tempest-VolumesActionsTest-1241157518 None] Attach volume completed successfully. Jul 03 01:21:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c96605b4-171f-4c46-bb14-620c1ad63d69 tempest-VolumesActionsTest-1241157518 None] Lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" released by "attach_volume" :: held 0.091s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1a6a1192-d68e-43f9-a6e9-c83008f33aa6 tempest-VolumesActionsTest-1241157518 None] Acquiring lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228-detach_volume" by "detach_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1a6a1192-d68e-43f9-a6e9-c83008f33aa6 tempest-VolumesActionsTest-1241157518 None] Lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:49 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1a6a1192-d68e-43f9-a6e9-c83008f33aa6 tempest-VolumesActionsTest-1241157518 None] Detaching volume 45ae5c96-860c-4c7b-bf78-edc5fc4e0228 from instance dac4a0fb-0c04-49ac-a9b2-b235310f0f27. Jul 03 01:21:50 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1a6a1192-d68e-43f9-a6e9-c83008f33aa6 tempest-VolumesActionsTest-1241157518 None] Detach volume completed successfully. Jul 03 01:21:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1a6a1192-d68e-43f9-a6e9-c83008f33aa6 tempest-VolumesActionsTest-1241157518 None] Lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:55 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-0fe40c3a-64d4-4b6c-ba73-38d88837b8db req-ad30e4a3-168f-41e3-a889-0447930daba8 tempest-TestShelveInstance-1531294479 None] Terminate volume connection completed successfully. Jul 03 01:21:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-0fe40c3a-64d4-4b6c-ba73-38d88837b8db req-ad30e4a3-168f-41e3-a889-0447930daba8 tempest-TestShelveInstance-1531294479 None] Deleting attachment 49634753-28de-4aaa-80f8-a05de4317ef1. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:21:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-3895bc0d-e9f2-4673-908b-27292fc50f8a req-b7087c87-d12d-433c-91f5-19599452f49e tempest-TestShelveInstance-1531294479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-3895bc0d-e9f2-4673-908b-27292fc50f8a req-b7087c87-d12d-433c-91f5-19599452f49e tempest-TestShelveInstance-1531294479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:59 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80bc272-a325-4529-8af6-1235c5d6845a]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-3895bc0d-e9f2-4673-908b-27292fc50f8a req-b7087c87-d12d-433c-91f5-19599452f49e tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:59 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 Jul 03 01:21:59 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:00 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-3895bc0d-e9f2-4673-908b-27292fc50f8a req-b7087c87-d12d-433c-91f5-19599452f49e tempest-TestShelveInstance-1531294479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" returned: 0 in 0.765s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-3895bc0d-e9f2-4673-908b-27292fc50f8a req-b7087c87-d12d-433c-91f5-19599452f49e tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:00 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 Jul 03 01:22:00 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:01 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-3895bc0d-e9f2-4673-908b-27292fc50f8a req-b7087c87-d12d-433c-91f5-19599452f49e tempest-TestShelveInstance-1531294479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" returned: 1 in 0.738s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-3895bc0d-e9f2-4673-908b-27292fc50f8a req-b7087c87-d12d-433c-91f5-19599452f49e tempest-TestShelveInstance-1531294479 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:22:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-3895bc0d-e9f2-4673-908b-27292fc50f8a req-b7087c87-d12d-433c-91f5-19599452f49e tempest-TestShelveInstance-1531294479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.542s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-3895bc0d-e9f2-4673-908b-27292fc50f8a req-b7087c87-d12d-433c-91f5-19599452f49e tempest-TestShelveInstance-1531294479 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7aa60bdc-df65-4257-8c98-266380681dd8', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:22:01 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-3895bc0d-e9f2-4673-908b-27292fc50f8a req-b7087c87-d12d-433c-91f5-19599452f49e tempest-TestShelveInstance-1531294479 None] attachment_update completed successfully. Jul 03 01:22:11 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:22:11 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:INSERT=1,cinder:SELECT=11,cinder:UPDATE=4 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:22:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f543762a-d022-4775-ac77-f55bbbdf5427 tempest-VolumesActionsTest-1241157518 None] Acquiring lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" by "attach_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f543762a-d022-4775-ac77-f55bbbdf5427 tempest-VolumesActionsTest-1241157518 None] Lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" acquired by "attach_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f543762a-d022-4775-ac77-f55bbbdf5427 tempest-VolumesActionsTest-1241157518 None] Attaching volume 45ae5c96-860c-4c7b-bf78-edc5fc4e0228 to instance 8301ad9b-57b7-4ada-b5d5-17c3a49f6cb6 at mountpoint /dev/vdb on host None. Jul 03 01:22:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f543762a-d022-4775-ac77-f55bbbdf5427 tempest-VolumesActionsTest-1241157518 None] Attach volume completed successfully. Jul 03 01:22:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f543762a-d022-4775-ac77-f55bbbdf5427 tempest-VolumesActionsTest-1241157518 None] Lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" released by "attach_volume" :: held 0.132s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65e8e1c5-9d11-484a-b0e2-58df4f838e07 tempest-VolumesActionsTest-1241157518 None] Acquiring lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228-detach_volume" by "detach_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65e8e1c5-9d11-484a-b0e2-58df4f838e07 tempest-VolumesActionsTest-1241157518 None] Lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:14 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-65e8e1c5-9d11-484a-b0e2-58df4f838e07 tempest-VolumesActionsTest-1241157518 None] Detaching volume 45ae5c96-860c-4c7b-bf78-edc5fc4e0228 from instance 8301ad9b-57b7-4ada-b5d5-17c3a49f6cb6. Jul 03 01:22:14 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-65e8e1c5-9d11-484a-b0e2-58df4f838e07 tempest-VolumesActionsTest-1241157518 None] Detach volume completed successfully. Jul 03 01:22:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65e8e1c5-9d11-484a-b0e2-58df4f838e07 tempest-VolumesActionsTest-1241157518 None] Lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:23 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae5e796-a6ae-451d-be7c-eedd568fe270]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:23 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 Jul 03 01:22:23 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:23 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" returned: 0 in 0.766s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:23 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94f1299-21f3-46b7-8059-5a9a41fa9c89]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:24 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 Jul 03 01:22:24 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:24 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" returned: 0 in 0.751s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.784d2110-441c-45da-aa21-0040710f3dd1os5r0hk5.img {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:24 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.784d2110-441c-45da-aa21-0040710f3dd1os5r0hk5.img Jul 03 01:22:24 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:22:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:22:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:22:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:27 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:22:27 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:29 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.383s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:29 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:22:29 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:22:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:22:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:22:29 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.784d2110-441c-45da-aa21-0040710f3dd1os5r0hk5.img" returned: 0 in 5.344s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:29 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d4248a-620e-404e-8d14-6f328aaf0d2a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:30 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 Jul 03 01:22:30 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:30 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" returned: 0 in 0.911s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:30 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.784d2110-441c-45da-aa21-0040710f3dd1os5r0hk5.img {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:22:30 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] Converted 1024.00 MB image at 191.57 MB/s Jul 03 01:22:30 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] 784d2110-441c-45da-aa21-0040710f3dd1 was raw, no need to convert to raw {{(pid=86357) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 03 01:22:33 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:INSERT=1,cinder:SELECT=9,cinder:UPDATE=4 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:22:40 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:22:42 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-e5480af5-6c6e-4be7-a4c3-41446d812b91 tempest-TestShelveInstance-1531294479 None] Terminate volume connection completed successfully. Jul 03 01:22:42 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-e5480af5-6c6e-4be7-a4c3-41446d812b91 tempest-TestShelveInstance-1531294479 None] Deleting attachment 7aa60bdc-df65-4257-8c98-266380681dd8. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:22:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Acquiring lock "cinder-e8ac86d3-57c0-47fe-bfaf-067e064e3c41-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Lock "cinder-e8ac86d3-57c0-47fe-bfaf-067e064e3c41-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Acquiring lock "cinder-quobyte-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Lock "cinder-quobyte-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:43 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fe4a04-522b-40ff-b5ef-7a5cf00e81fd]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:43 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 Jul 03 01:22:43 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:44 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" returned: 0 in 0.803s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:44 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 Jul 03 01:22:44 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:45 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" returned: 1 in 0.867s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:22:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:45 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41 Jul 03 01:22:45 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:45 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" returned: 0 in 0.795s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Lock "cinder-quobyte-e8ac86d3-57c0-47fe-bfaf-067e064e3c41" released by "delete_volume" :: held 2.554s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:46 devstack cinder-volume[86357]: DEBUG cinder.quota [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Created reservations ['6c21ba34-8fa1-463b-9efb-df885bce247f', 'aa7df20b-e0f6-4aca-8b80-08ca8ae656a7', 'a1c6dba8-7fb7-4461-8142-1800fe58436c', 'f14c39bc-3439-4e8a-b229-00548f96e853'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:22:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:22:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:22:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:46 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:22:46 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:47 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.712s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:47 devstack cinder-volume[86357]: DEBUG cinder.manager [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:22:47 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Deleted volume successfully. Jul 03 01:22:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [req-be232e54-dce2-4c2d-b90d-d5e341a4800c req-783888c4-be23-497f-969c-61239b8febaa tempest-TestShelveInstance-1531294479 None] Lock "cinder-e8ac86d3-57c0-47fe-bfaf-067e064e3c41-delete_volume" released by "delete_volume" :: held 3.767s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.951s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] Uploaded volume to glance image-id: 784d2110-441c-45da-aa21-0040710f3dd1. {{(pid=86357) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 01:22:51 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3348f242-4a2c-44e6-8b9b-806121bf7a96 tempest-VolumesActionsTest-1241157518 None] Copy volume to image completed successfully. Jul 03 01:22:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:52 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[098422b2-3568-4c74-abc2-0645eb728c26]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:52 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 Jul 03 01:22:52 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:53 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" returned: 0 in 0.815s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:53 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4e85f4-db57-4acf-ac7e-e4074524d73d]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:53 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 Jul 03 01:22:53 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:53 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" returned: 0 in 0.781s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:53 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img Jul 03 01:22:53 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:57 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:22:58 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img" returned: 0 in 4.863s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:58 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f079f64-ed27-4c4b-a1bf-2b2f0403ae09]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:58 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 Jul 03 01:22:58 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:59 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" returned: 0 in 1.016s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:59 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:22:59 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Converted 1024.00 MB image at 210.54 MB/s Jul 03 01:22:59 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] 1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35 was raw, converting to qcow2 {{(pid=86357) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 03 01:22:59 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d17198e-43e3-48a9-abd3-116f101ad938]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:59 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img Jul 03 01:22:59 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:00 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img" returned: 0 in 0.726s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:00 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img Jul 03 01:23:00 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:01 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img" returned: 1 in 0.739s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:23:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img /opt/stack/data/cinder/conversion/vol_upload_1_tptcn3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:01 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img /opt/stack/data/cinder/conversion/vol_upload_1_tptcn3 Jul 03 01:23:01 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:02 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img /opt/stack/data/cinder/conversion/vol_upload_1_tptcn3" returned: 0 in 0.709s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:02 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Image conversion details: src /opt/stack/data/cinder/conversion/45ae5c96-860c-4c7b-bf78-edc5fc4e0228.temp_image.1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35urwh4_7s.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_1_tptcn3 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:23:02 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 03 01:23:02 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecb4f2e-9ea1-40cf-977e-4f137737d668]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1_tptcn3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:02 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1_tptcn3 Jul 03 01:23:02 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:02 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=1 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:23:02 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1_tptcn3" returned: 0 in 0.747s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.988s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Uploaded volume to glance image-id: 1f1b94ce-49d5-4c3a-90d7-c19e41aa7e35. {{(pid=86357) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 01:23:04 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d8e0a1b8-ffd0-4145-9199-ad2c76461fdb tempest-VolumesActionsTest-1241157518 None] Copy volume to image completed successfully. Jul 03 01:23:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Acquiring lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:23:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:23:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Acquiring lock "cinder-quobyte-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:23:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Lock "cinder-quobyte-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:23:05 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d53595-20a4-4c33-b97b-618c5a1911e5]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:05 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 Jul 03 01:23:05 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:06 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" returned: 0 in 0.783s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:06 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228 Jul 03 01:23:06 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:07 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" returned: 0 in 0.703s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Lock "cinder-quobyte-45ae5c96-860c-4c7b-bf78-edc5fc4e0228" released by "delete_volume" :: held 1.528s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:23:07 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Created reservations ['9e90bd96-338f-460a-a1c4-f20f6804a872', '0791a8cf-d479-4880-a0f3-1a40785985eb', '6103ec8c-3d61-41fa-9e8c-ae8866a9fd61', '62a5d496-5ab6-4548-a937-d3a6529929ad'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:23:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:07 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:23:07 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:08 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.684s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:08 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:23:08 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Deleted volume successfully. Jul 03 01:23:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4a6eb7f0-7d99-4900-b1b2-b0775d8c1ec4 tempest-VolumesActionsTest-1241157518 None] Lock "cinder-45ae5c96-860c-4c7b-bf78-edc5fc4e0228-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Flow 'volume_create_manager' (8a65192a-2b76-42fa-b547-e7812e9e145b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fdec4b-1fde-4e0a-b106-98a93d1248a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fdec4b-1fde-4e0a-b106-98a93d1248a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2044746007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58793fe-0bb4-4b74-a699-41c33317ec4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecfaafa86ef44c9fbc6e995c95a320a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:15Z,use_quota=True,user_id='f86d5db33aa04db89453f92c616c8fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15f22a1-8968-49f7-979c-7816f97d38cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15f22a1-8968-49f7-979c-7816f97d38cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5244ba-f79e-4c76-ad01-b0def55cff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5244ba-f79e-4c76-ad01-b0def55cff4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b58793fe-0bb4-4b74-a699-41c33317ec4b', 'volume_name': 'volume-b58793fe-0bb4-4b74-a699-41c33317ec4b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51eeb116-c16d-4307-a2e8-065cf0f8f345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51eeb116-c16d-4307-a2e8-065cf0f8f345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9dd7cf5-a0c0-4e22-ba6b-0ba4b4482292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:15 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Volume b58793fe-0bb4-4b74-a699-41c33317ec4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b58793fe-0bb4-4b74-a699-41c33317ec4b', 'volume_size': 1} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2044746007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58793fe-0bb4-4b74-a699-41c33317ec4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecfaafa86ef44c9fbc6e995c95a320a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:15Z,use_quota=True,user_id='f86d5db33aa04db89453f92c616c8fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Creating volume b58793fe-0bb4-4b74-a699-41c33317ec4b {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:23:15 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:23:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:15 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b 1073741824 Jul 03 01:23:15 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:16 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b 1073741824" returned: 0 in 0.996s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:16 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b Jul 03 01:23:16 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:17 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b" returned: 0 in 0.657s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:23:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9dd7cf5-a0c0-4e22-ba6b-0ba4b4482292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b58793fe-0bb4-4b74-a699-41c33317ec4b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46759cfe-aeeb-4d3c-8fcb-c09b9faa80a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:17 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Volume volume-b58793fe-0bb4-4b74-a699-41c33317ec4b (b58793fe-0bb4-4b74-a699-41c33317ec4b): created successfully Jul 03 01:23:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46759cfe-aeeb-4d3c-8fcb-c09b9faa80a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Flow 'volume_create_manager' (8a65192a-2b76-42fa-b547-e7812e9e145b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:17 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a130166f-6411-4544-a0d7-06180ebc5218 tempest-VolumesCloneTest-1718998434 None] Created volume successfully. Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Flow 'volume_create_manager' (84fa5833-3548-426a-9d48-9a9dd8876c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f22712-a0a9-4e29-b7f3-17a1d8394937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f22712-a0a9-4e29-b7f3-17a1d8394937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1301368935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ae32eb-4de8-4a70-abe1-d66570dd64a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecfaafa86ef44c9fbc6e995c95a320a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b58793fe-0bb4-4b74-a699-41c33317ec4b,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:18Z,use_quota=True,user_id='f86d5db33aa04db89453f92c616c8fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2327c5e-abfb-40f6-9c83-b2d4db408758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2327c5e-abfb-40f6-9c83-b2d4db408758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7246e8e2-05da-4436-9db4-68b5218260b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7246e8e2-05da-4436-9db4-68b5218260b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '97ae32eb-4de8-4a70-abe1-d66570dd64a2', 'volume_name': 'volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2', 'volume_size': 2, 'source_volid': 'b58793fe-0bb4-4b74-a699-41c33317ec4b', 'source_volstatus': 'available'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4422bc01-38e7-4f9c-8460-2302ba7cad11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4422bc01-38e7-4f9c-8460-2302ba7cad11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495c3475-bd8d-4202-bf17-1ee0c1b6285f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:18 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Volume 97ae32eb-4de8-4a70-abe1-d66570dd64a2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2', 'volume_size': 2, 'source_volid': 'b58793fe-0bb4-4b74-a699-41c33317ec4b', 'source_volstatus': 'available'} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:18 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Cloning volume b58793fe-0bb4-4b74-a699-41c33317ec4b to volume 97ae32eb-4de8-4a70-abe1-d66570dd64a2 Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Creating offline snapshot 64a68a2c-b413-4a0a-b77a-d37cf48c312d of volume b58793fe-0bb4-4b74-a699-41c33317ec4b {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba935a48-8d09-4eea-a8e6-b503126a3877]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:18 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b Jul 03 01:23:18 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:19 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b" returned: 0 in 0.816s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:19 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d 1G Jul 03 01:23:19 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:19 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d 1G" returned: 0 in 0.850s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b58793fe-0bb4-4b74-a699-41c33317ec4b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:19 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b58793fe-0bb4-4b74-a699-41c33317ec4b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d Jul 03 01:23:19 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b58793fe-0bb4-4b74-a699-41c33317ec4b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d" returned: 0 in 0.701s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:20 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d is being set with open permissions: ugo+rw Jul 03 01:23:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:20 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:20 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d Jul 03 01:23:20 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:21 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d" returned: 0 in 0.698s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:21 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.info Jul 03 01:23:21 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:21 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.info" returned: 0 in 0.632s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:21 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.info is being set with open permissions: ugo+rw Jul 03 01:23:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:21 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.info Jul 03 01:23:21 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:22 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.info" returned: 0 in 0.773s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Acquiring lock "cinder-quobyte-97ae32eb-4de8-4a70-abe1-d66570dd64a2" by "_copy_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:23:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Lock "cinder-quobyte-97ae32eb-4de8-4a70-abe1-d66570dd64a2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:23:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] snapshot: 64a68a2c-b413-4a0a-b77a-d37cf48c312d, volume: 97ae32eb-4de8-4a70-abe1-d66570dd64a2, {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:23:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:22 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8aa333-3958-40e2-b791-325801874bbc]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:22 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d Jul 03 01:23:22 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:23 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d" returned: 0 in 0.855s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b58793fe-0bb4-4b74-a699-41c33317ec4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:23:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:23:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Creating direct copy from snapshot {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:23:23 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8527577-dd6a-4188-8d1f-f184b5a20da5]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:23 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b Jul 03 01:23:23 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:24 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b" returned: 0 in 0.795s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:24 devstack cinder-volume[86357]: DEBUG cinder.utils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Path /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2 not found in is_blk_device check {{(pid=86357) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:23:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:24 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2 Jul 03 01:23:24 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:26 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:23:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Flow 'volume_create_manager' (43d26d0d-2a50-4920-86c8-37ae020ffa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dcfbe18-5b5a-4cee-8910-e1b88a86c45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dcfbe18-5b5a-4cee-8910-e1b88a86c45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1090736441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1ac65a-2f5d-4b0a-afcc-eec446a645d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31bbb70495e64fd6a076945ecc2a4a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:27Z,use_quota=True,user_id='7fc217da9abb4c4587fc45025320e0e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46260394-193f-4af0-b2f4-2220d633a0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46260394-193f-4af0-b2f4-2220d633a0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae084ec5-e917-4821-ab46-8c3a18e00409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae084ec5-e917-4821-ab46-8c3a18e00409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1ac65a-2f5d-4b0a-afcc-eec446a645d6', 'volume_name': 'volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346ee240-c073-4172-84b7-2c97a063bc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346ee240-c073-4172-84b7-2c97a063bc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15968ca4-ef24-476e-a73f-803b2a97b3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:27 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Volume ae1ac65a-2f5d-4b0a-afcc-eec446a645d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6', 'volume_size': 1} Jul 03 01:23:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:23:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:27 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:23:27 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:29 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.543s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:29 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:23:29 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:23:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:23:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:23:29 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2" returned: 0 in 5.217s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:29 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74e902e-0ba3-42f8-a149-87253763978b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:29 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b Jul 03 01:23:29 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:30 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b" returned: 0 in 0.968s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:30 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:23:30 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Converted 1024.00 MB image at 196.24 MB/s Jul 03 01:23:30 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2 is being set with open permissions: ugo+rw Jul 03 01:23:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:30 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2 Jul 03 01:23:30 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:31 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2" returned: 0 in 0.641s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Lock "cinder-quobyte-97ae32eb-4de8-4a70-abe1-d66570dd64a2" released by "_copy_volume_from_snapshot" :: held 8.577s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:23:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Acquiring lock "cinder-quobyte-64a68a2c-b413-4a0a-b77a-d37cf48c312d" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:23:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Lock "cinder-quobyte-64a68a2c-b413-4a0a-b77a-d37cf48c312d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:23:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Deleting offline snapshot 64a68a2c-b413-4a0a-b77a-d37cf48c312d of volume b58793fe-0bb4-4b74-a699-41c33317ec4b {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:23:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] snapshot_file for this snap is: volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:23:31 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[391444d7-bc3c-4fb8-8867-a588fbaf1992]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:31 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d Jul 03 01:23:31 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:32 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d" returned: 0 in 0.734s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b58793fe-0bb4-4b74-a699-41c33317ec4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:23:32 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4aec52-2b65-44d5-a101-8d57d0a5d1ad]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:32 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b Jul 03 01:23:32 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:32 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b" returned: 0 in 0.722s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:32 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d Jul 03 01:23:32 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:33 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d" returned: 0 in 0.709s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:33 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d Jul 03 01:23:33 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:34 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b.64a68a2c-b413-4a0a-b77a-d37cf48c312d" returned: 0 in 0.660s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Lock "cinder-quobyte-64a68a2c-b413-4a0a-b77a-d37cf48c312d" released by "_delete_snapshot" :: held 2.927s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.167s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.343s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1090736441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1ac65a-2f5d-4b0a-afcc-eec446a645d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31bbb70495e64fd6a076945ecc2a4a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:27Z,use_quota=True,user_id='7fc217da9abb4c4587fc45025320e0e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Creating volume ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:23:34 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495c3475-bd8d-4202-bf17-1ee0c1b6285f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2', 'volume_size': 2, 'source_volid': 'b58793fe-0bb4-4b74-a699-41c33317ec4b', 'source_volstatus': 'available'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d91262-b4d5-4a1c-9123-d10bfdfe5b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:34 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 1073741824 Jul 03 01:23:34 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:34 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Volume volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2 (97ae32eb-4de8-4a70-abe1-d66570dd64a2): created successfully Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d91262-b4d5-4a1c-9123-d10bfdfe5b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Flow 'volume_create_manager' (84fa5833-3548-426a-9d48-9a9dd8876c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:34 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-79c42fa0-0af0-466a-ab4c-5f626e0fbeb3 tempest-VolumesCloneTest-1718998434 None] Created volume successfully. Jul 03 01:23:35 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Acquiring lock "cinder-97ae32eb-4de8-4a70-abe1-d66570dd64a2-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:23:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 1073741824" returned: 0 in 1.028s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Lock "cinder-97ae32eb-4de8-4a70-abe1-d66570dd64a2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:23:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Acquiring lock "cinder-quobyte-97ae32eb-4de8-4a70-abe1-d66570dd64a2" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:23:35 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 Jul 03 01:23:35 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Lock "cinder-quobyte-97ae32eb-4de8-4a70-abe1-d66570dd64a2" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:23:35 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdafa62c-9bb6-4f7e-b87d-85881e20ccd2]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:35 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2 Jul 03 01:23:35 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:36 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" returned: 0 in 0.796s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:23:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15968ca4-ef24-476e-a73f-803b2a97b3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e47b342-1716-4157-9f80-70afa1f5096c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:36 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Volume volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 (ae1ac65a-2f5d-4b0a-afcc-eec446a645d6): created successfully Jul 03 01:23:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e47b342-1716-4157-9f80-70afa1f5096c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Flow 'volume_create_manager' (43d26d0d-2a50-4920-86c8-37ae020ffa19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:36 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f517cb12-0fc1-4311-97cc-edcc18d517de tempest-TestStampPattern-819129895 None] Created volume successfully. Jul 03 01:23:36 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2" returned: 0 in 0.864s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:36 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2 Jul 03 01:23:36 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:37 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-97ae32eb-4de8-4a70-abe1-d66570dd64a2" returned: 0 in 0.699s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Lock "cinder-quobyte-97ae32eb-4de8-4a70-abe1-d66570dd64a2" released by "delete_volume" :: held 1.628s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Created reservations ['0286d091-f76a-4bd8-9bf9-693e27afd555', '4c97e2da-6008-4415-aecf-751a107b0976', 'c286163f-4bf8-4e3a-8b21-0cfee8b1e445', '6129484f-67ab-4392-a64e-cbe704040457'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:37 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:23:37 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Acquiring lock "cinder-b58793fe-0bb4-4b74-a699-41c33317ec4b-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Lock "cinder-b58793fe-0bb4-4b74-a699-41c33317ec4b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Acquiring lock "cinder-quobyte-b58793fe-0bb4-4b74-a699-41c33317ec4b" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Lock "cinder-quobyte-b58793fe-0bb4-4b74-a699-41c33317ec4b" acquired by "delete_volume" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6151f98-2e83-43dd-8490-6a8a243ac072]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:37 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.672s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:23:37 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Deleted volume successfully. Jul 03 01:23:37 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b Jul 03 01:23:37 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4e92f504-8f24-44f8-ae73-a907b70626aa tempest-VolumesCloneTest-1718998434 None] Lock "cinder-97ae32eb-4de8-4a70-abe1-d66570dd64a2-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:23:38 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b" returned: 0 in 0.843s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:38 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b Jul 03 01:23:38 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:39 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b58793fe-0bb4-4b74-a699-41c33317ec4b" returned: 0 in 0.662s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Lock "cinder-quobyte-b58793fe-0bb4-4b74-a699-41c33317ec4b" released by "delete_volume" :: held 1.566s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:23:39 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Created reservations ['3667235e-290c-4936-bfb1-ccb6cbc67bb0', '6c6f4dd1-606e-48dc-8088-53e89ccaf87b', '13d72404-b000-4920-bc84-2dec7d6b2d21', '11dc01b8-cf61-487e-860b-23b39b47aa90'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:23:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:39 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:23:39 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:40 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.667s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:40 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:23:40 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Deleted volume successfully. Jul 03 01:23:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-97d9bb4a-98cd-40e2-84c2-9c48d616dea4 tempest-VolumesCloneTest-1718998434 None] Lock "cinder-b58793fe-0bb4-4b74-a699-41c33317ec4b-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (ae6889d1-e1ff-4db3-a2da-b6b73eb7ba3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1045a0e8-4cfe-43ab-8bfe-e929124b66dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1045a0e8-4cfe-43ab-8bfe-e929124b66dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-426651653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b6b040-126d-4803-88d3-7a312f71cf17,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2e0f72ddd2b49b6a48b2a7f591eefb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:43Z,use_quota=True,user_id='fedf312e51d5407da2c070fb792ade6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a97eb7a-e8c4-4ff1-9b3f-dea3b1abbfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a97eb7a-e8c4-4ff1-9b3f-dea3b1abbfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bea701-4f71-48c7-9f84-99286683246e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bea701-4f71-48c7-9f84-99286683246e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63b6b040-126d-4803-88d3-7a312f71cf17', 'volume_name': 'volume-63b6b040-126d-4803-88d3-7a312f71cf17', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4923bdb7-fa06-40d7-8ff2-3f1d39a96439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4923bdb7-fa06-40d7-8ff2-3f1d39a96439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9536771c-c325-458f-a823-68ef388adb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:43 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Volume 63b6b040-126d-4803-88d3-7a312f71cf17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63b6b040-126d-4803-88d3-7a312f71cf17', 'volume_size': 1} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-426651653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b6b040-126d-4803-88d3-7a312f71cf17,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2e0f72ddd2b49b6a48b2a7f591eefb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:43Z,use_quota=True,user_id='fedf312e51d5407da2c070fb792ade6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Creating volume 63b6b040-126d-4803-88d3-7a312f71cf17 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:23:43 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:23:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-63b6b040-126d-4803-88d3-7a312f71cf17 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:43 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-63b6b040-126d-4803-88d3-7a312f71cf17 1073741824 Jul 03 01:23:43 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:44 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-63b6b040-126d-4803-88d3-7a312f71cf17 1073741824" returned: 0 in 0.929s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-63b6b040-126d-4803-88d3-7a312f71cf17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:44 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-63b6b040-126d-4803-88d3-7a312f71cf17 Jul 03 01:23:44 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:44 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-63b6b040-126d-4803-88d3-7a312f71cf17" returned: 0 in 0.683s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:23:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9536771c-c325-458f-a823-68ef388adb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63b6b040-126d-4803-88d3-7a312f71cf17', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f7d522-39ca-44da-b8e5-295a6b4f5bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:44 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Volume volume-63b6b040-126d-4803-88d3-7a312f71cf17 (63b6b040-126d-4803-88d3-7a312f71cf17): created successfully Jul 03 01:23:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f7d522-39ca-44da-b8e5-295a6b4f5bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:44 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (ae6889d1-e1ff-4db3-a2da-b6b73eb7ba3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:44 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-aff4b891-762b-4faf-8939-698d1cf6013d tempest-VolumesGetTest-809850360 None] Created volume successfully. Jul 03 01:23:45 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:23:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (7ee17eeb-517a-44cd-8cf6-535cc7fff914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b5d3fa-be85-4b87-8449-2b3d7468081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:45 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b5d3fa-be85-4b87-8449-2b3d7468081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1058504481',display_name='tempest-VolumesGetTest-Volume-1905460986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb30cf9-57de-4e40-9490-cb5dd9611480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e0f72ddd2b49b6a48b2a7f591eefb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:46Z,use_quota=True,user_id='fedf312e51d5407da2c070fb792ade6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1533806a-336d-4f94-b4f3-23c9c58b12f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1533806a-336d-4f94-b4f3-23c9c58b12f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893cc053-cc3c-4e98-9fb2-2754b1957561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893cc053-cc3c-4e98-9fb2-2754b1957561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbb30cf9-57de-4e40-9490-cb5dd9611480', 'volume_name': 'volume-dbb30cf9-57de-4e40-9490-cb5dd9611480', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8941ecae-ef79-488c-b1d3-1529f7e1d5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8941ecae-ef79-488c-b1d3-1529f7e1d5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10caf167-5775-4506-9e83-6c1f90221547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:46 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Volume dbb30cf9-57de-4e40-9490-cb5dd9611480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbb30cf9-57de-4e40-9490-cb5dd9611480', 'volume_size': 1} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1058504481',display_name='tempest-VolumesGetTest-Volume-1905460986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb30cf9-57de-4e40-9490-cb5dd9611480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e0f72ddd2b49b6a48b2a7f591eefb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:46Z,use_quota=True,user_id='fedf312e51d5407da2c070fb792ade6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Creating volume dbb30cf9-57de-4e40-9490-cb5dd9611480 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:23:46 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:23:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-dbb30cf9-57de-4e40-9490-cb5dd9611480 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:46 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-dbb30cf9-57de-4e40-9490-cb5dd9611480 1073741824 Jul 03 01:23:46 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:47 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-dbb30cf9-57de-4e40-9490-cb5dd9611480 1073741824" returned: 0 in 1.000s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-dbb30cf9-57de-4e40-9490-cb5dd9611480 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:47 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-dbb30cf9-57de-4e40-9490-cb5dd9611480 Jul 03 01:23:47 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:47 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-dbb30cf9-57de-4e40-9490-cb5dd9611480" returned: 0 in 0.690s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:23:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10caf167-5775-4506-9e83-6c1f90221547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbb30cf9-57de-4e40-9490-cb5dd9611480', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdea1dea-7767-44b5-84eb-43e4ad27e7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:47 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Volume volume-dbb30cf9-57de-4e40-9490-cb5dd9611480 (dbb30cf9-57de-4e40-9490-cb5dd9611480): created successfully Jul 03 01:23:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdea1dea-7767-44b5-84eb-43e4ad27e7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (7ee17eeb-517a-44cd-8cf6-535cc7fff914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:47 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-67c7e0e5-5b0b-48d9-8c14-420091db862a tempest-VolumesGetTest-809850360 None] Created volume successfully. Jul 03 01:23:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-dbb30cf9-57de-4e40-9490-cb5dd9611480-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:23:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Lock "cinder-dbb30cf9-57de-4e40-9490-cb5dd9611480-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:23:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-quobyte-dbb30cf9-57de-4e40-9490-cb5dd9611480" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:23:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-dbb30cf9-57de-4e40-9490-cb5dd9611480" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:23:48 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[914f4220-ef4b-4d81-95ce-b45ed820b5ba]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-dbb30cf9-57de-4e40-9490-cb5dd9611480 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:48 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-dbb30cf9-57de-4e40-9490-cb5dd9611480 Jul 03 01:23:48 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:49 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-dbb30cf9-57de-4e40-9490-cb5dd9611480" returned: 0 in 0.834s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-dbb30cf9-57de-4e40-9490-cb5dd9611480 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:49 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-dbb30cf9-57de-4e40-9490-cb5dd9611480 Jul 03 01:23:49 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:49 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-dbb30cf9-57de-4e40-9490-cb5dd9611480" returned: 0 in 0.685s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-dbb30cf9-57de-4e40-9490-cb5dd9611480" released by "delete_volume" :: held 1.577s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:23:49 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Created reservations ['0dc747ae-1db0-4b71-927b-e14f3b2572be', '71a6a05d-bbc9-4eb4-9d08-f2bd01a7c028', '29c5e6c2-5d53-43d5-867d-001e8f69763d', '9449f532-d310-46fa-a0f2-d14d86bee961'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:50 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:23:50 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-63b6b040-126d-4803-88d3-7a312f71cf17-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Lock "cinder-63b6b040-126d-4803-88d3-7a312f71cf17-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-quobyte-63b6b040-126d-4803-88d3-7a312f71cf17" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-63b6b040-126d-4803-88d3-7a312f71cf17" acquired by "delete_volume" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a81984-ce19-4883-a9dd-ef09a598f0bc]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-63b6b040-126d-4803-88d3-7a312f71cf17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:50 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.688s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:23:50 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Deleted volume successfully. Jul 03 01:23:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4ae6dd05-f0df-458f-9407-b42f7e3da200 tempest-VolumesGetTest-809850360 None] Lock "cinder-dbb30cf9-57de-4e40-9490-cb5dd9611480-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:23:50 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-63b6b040-126d-4803-88d3-7a312f71cf17 Jul 03 01:23:50 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:51 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-63b6b040-126d-4803-88d3-7a312f71cf17" returned: 0 in 0.793s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-63b6b040-126d-4803-88d3-7a312f71cf17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:51 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-63b6b040-126d-4803-88d3-7a312f71cf17 Jul 03 01:23:51 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:52 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-63b6b040-126d-4803-88d3-7a312f71cf17" returned: 0 in 0.677s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-63b6b040-126d-4803-88d3-7a312f71cf17" released by "delete_volume" :: held 1.520s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:23:52 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Created reservations ['d7f5ecba-5083-4924-9711-1c650909f0f9', '56a1b7a4-8676-4f1d-881f-53698263d839', '8ddbc003-4a9d-4725-b928-d70a851d1519', 'c93da0df-52c3-4a70-aec8-8f9af54012de'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:23:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:52 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:23:52 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:52 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.695s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:52 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:23:52 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Deleted volume successfully. Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-92fd071e-562e-482b-8ea1-6768016b6fe7 tempest-VolumesGetTest-809850360 None] Lock "cinder-63b6b040-126d-4803-88d3-7a312f71cf17-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (fd2a5298-2ec9-4b74-b7e5-1237ca97a866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fbecdc1-d730-4f51-835c-7c5ad75202bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fbecdc1-d730-4f51-835c-7c5ad75202bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1006838202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492ed482-d6ea-4c51-b1e1-c4adb330c730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e0f72ddd2b49b6a48b2a7f591eefb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:53Z,use_quota=True,user_id='fedf312e51d5407da2c070fb792ade6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1685c9e-89cd-49e2-8b99-3442af321194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1685c9e-89cd-49e2-8b99-3442af321194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a650ae00-c3e5-4f37-b771-568b934ab19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a650ae00-c3e5-4f37-b771-568b934ab19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '492ed482-d6ea-4c51-b1e1-c4adb330c730', 'volume_name': 'volume-492ed482-d6ea-4c51-b1e1-c4adb330c730', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbf55ba-3378-4dee-adbe-dc48bfc70a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbf55ba-3378-4dee-adbe-dc48bfc70a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc90804-00ac-4f4e-96ba-c1bf633f9a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:53 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Volume 492ed482-d6ea-4c51-b1e1-c4adb330c730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-492ed482-d6ea-4c51-b1e1-c4adb330c730', 'volume_size': 1} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1006838202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492ed482-d6ea-4c51-b1e1-c4adb330c730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e0f72ddd2b49b6a48b2a7f591eefb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:53Z,use_quota=True,user_id='fedf312e51d5407da2c070fb792ade6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Creating volume 492ed482-d6ea-4c51-b1e1-c4adb330c730 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:23:53 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:23:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:53 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 1073741824 Jul 03 01:23:53 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:54 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 1073741824" returned: 0 in 0.818s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:54 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 Jul 03 01:23:54 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:54 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730" returned: 0 in 0.674s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:23:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc90804-00ac-4f4e-96ba-c1bf633f9a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-492ed482-d6ea-4c51-b1e1-c4adb330c730', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b066d8e-9723-4733-abdd-c740a4be85b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:54 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Volume volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 (492ed482-d6ea-4c51-b1e1-c4adb330c730): created successfully Jul 03 01:23:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b066d8e-9723-4733-abdd-c740a4be85b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (fd2a5298-2ec9-4b74-b7e5-1237ca97a866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:55 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d5de7ddc-5947-4943-a845-4513818ec1d8 tempest-VolumesGetTest-809850360 None] Created volume successfully. Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (62b7ee52-3a79-4fa9-93d1-3f3cdec4aee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167ca718-b413-48d1-b013-45261d2df5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167ca718-b413-48d1-b013-45261d2df5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1811598587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ebcb5f-cdcc-48f4-97d3-de46796ce527,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2e0f72ddd2b49b6a48b2a7f591eefb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=492ed482-d6ea-4c51-b1e1-c4adb330c730,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:56Z,use_quota=True,user_id='fedf312e51d5407da2c070fb792ade6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d935129-686c-4d17-8185-c02961ed734f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d935129-686c-4d17-8185-c02961ed734f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431a3b0a-3e81-452c-ab65-938854212d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431a3b0a-3e81-452c-ab65-938854212d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '06ebcb5f-cdcc-48f4-97d3-de46796ce527', 'volume_name': 'volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527', 'volume_size': 1, 'source_volid': '492ed482-d6ea-4c51-b1e1-c4adb330c730', 'source_volstatus': 'available'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91da24b6-a4c3-48e2-89f6-2e9faa9faea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91da24b6-a4c3-48e2-89f6-2e9faa9faea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778f22d3-a6d9-4b79-996a-fa17262f8fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:55 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Volume 06ebcb5f-cdcc-48f4-97d3-de46796ce527: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527', 'volume_size': 1, 'source_volid': '492ed482-d6ea-4c51-b1e1-c4adb330c730', 'source_volstatus': 'available'} Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:55 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Cloning volume 492ed482-d6ea-4c51-b1e1-c4adb330c730 to volume 06ebcb5f-cdcc-48f4-97d3-de46796ce527 Jul 03 01:23:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Creating offline snapshot 50fb87aa-d783-40d8-a5a4-51d39025255f of volume 492ed482-d6ea-4c51-b1e1-c4adb330c730 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:23:56 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ba60c9-1b3b-49bf-b37d-2ffbbd569b2f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:56 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 Jul 03 01:23:56 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:56 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730" returned: 0 in 0.751s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:56 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f 1G Jul 03 01:23:56 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:57 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f 1G" returned: 0 in 0.763s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:57 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f Jul 03 01:23:57 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:58 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f" returned: 0 in 0.658s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:58 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f is being set with open permissions: ugo+rw Jul 03 01:23:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:58 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f Jul 03 01:23:58 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:58 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f" returned: 0 in 0.619s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:58 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=44,cinder:UPDATE=58,cinder:INSERT=14,cinder:DELETE=6 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:23:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:58 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.info Jul 03 01:23:58 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:59 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.info" returned: 0 in 0.637s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:59 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.info is being set with open permissions: ugo+rw Jul 03 01:23:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:59 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.info Jul 03 01:23:59 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:00 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.info" returned: 0 in 0.650s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-quobyte-06ebcb5f-cdcc-48f4-97d3-de46796ce527" by "_copy_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-06ebcb5f-cdcc-48f4-97d3-de46796ce527" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] snapshot: 50fb87aa-d783-40d8-a5a4-51d39025255f, volume: 06ebcb5f-cdcc-48f4-97d3-de46796ce527, {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c377e8-ca0f-4c1a-abd9-ed3e0b2d6fac]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:00 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f Jul 03 01:24:00 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:00 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f" returned: 0 in 0.771s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-492ed482-d6ea-4c51-b1e1-c4adb330c730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Creating direct copy from snapshot {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba603de-7fb3-432d-888c-4fb59a9c7cb3]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:01 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 Jul 03 01:24:01 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:01 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730" returned: 0 in 0.745s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:01 devstack cinder-volume[86357]: DEBUG cinder.utils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Path /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527 not found in is_blk_device check {{(pid=86357) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:24:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:01 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527 Jul 03 01:24:01 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:06 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527" returned: 0 in 4.405s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:06 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc760b8-55fd-46ed-b67e-0f93607017da]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:06 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 Jul 03 01:24:06 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:07 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730" returned: 0 in 0.883s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:07 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730, size 1024.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:24:07 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Converted 1024.00 MB image at 232.39 MB/s Jul 03 01:24:07 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527 is being set with open permissions: ugo+rw Jul 03 01:24:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:07 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527 Jul 03 01:24:07 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:07 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527" returned: 0 in 0.630s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-06ebcb5f-cdcc-48f4-97d3-de46796ce527" released by "_copy_volume_from_snapshot" :: held 7.511s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:07 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=47,cinder:UPDATE=65,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:24:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-quobyte-50fb87aa-d783-40d8-a5a4-51d39025255f" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-50fb87aa-d783-40d8-a5a4-51d39025255f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Deleting offline snapshot 50fb87aa-d783-40d8-a5a4-51d39025255f of volume 492ed482-d6ea-4c51-b1e1-c4adb330c730 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:24:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] snapshot_file for this snap is: volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:24:07 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec3e6ff-63d9-424a-9253-8b2f5c418a22]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:07 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f Jul 03 01:24:07 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:08 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f" returned: 0 in 0.736s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-492ed482-d6ea-4c51-b1e1-c4adb330c730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:24:08 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df85a75-fc01-40a0-9a82-bd7ddfc9944f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:08 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 Jul 03 01:24:08 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:09 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730" returned: 0 in 0.743s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:09 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f Jul 03 01:24:09 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:09 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f" returned: 0 in 0.734s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:09 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f Jul 03 01:24:09 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-8c9ae10c-6983-437d-b982-a903b0c28771 req-fefd0b92-9da1-4fbf-8ef4-d442cc1ac154 tempest-TestStampPattern-819129895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:10 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730.50fb87aa-d783-40d8-a5a4-51d39025255f" returned: 0 in 0.634s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-50fb87aa-d783-40d8-a5a4-51d39025255f" released by "_delete_snapshot" :: held 2.928s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.686s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-8c9ae10c-6983-437d-b982-a903b0c28771 req-fefd0b92-9da1-4fbf-8ef4-d442cc1ac154 tempest-TestStampPattern-819129895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.156s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778f22d3-a6d9-4b79-996a-fa17262f8fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527', 'volume_size': 1, 'source_volid': '492ed482-d6ea-4c51-b1e1-c4adb330c730', 'source_volstatus': 'available'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3185b6e0-026c-4675-b906-29719b115ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:10 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c011c89-113b-4f0c-90c2-52984d16be79]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-8c9ae10c-6983-437d-b982-a903b0c28771 req-fefd0b92-9da1-4fbf-8ef4-d442cc1ac154 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:10 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Volume volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527 (06ebcb5f-cdcc-48f4-97d3-de46796ce527): created successfully Jul 03 01:24:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3185b6e0-026c-4675-b906-29719b115ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (62b7ee52-3a79-4fa9-93d1-3f3cdec4aee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:24:10 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1c4d69c3-327b-4fc4-9466-6ed1f40542df tempest-VolumesGetTest-809850360 None] Created volume successfully. Jul 03 01:24:10 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 Jul 03 01:24:10 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:11 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-8c9ae10c-6983-437d-b982-a903b0c28771 req-fefd0b92-9da1-4fbf-8ef4-d442cc1ac154 tempest-TestStampPattern-819129895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" returned: 0 in 0.837s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-8c9ae10c-6983-437d-b982-a903b0c28771 req-fefd0b92-9da1-4fbf-8ef4-d442cc1ac154 tempest-TestStampPattern-819129895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.865s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (b231b65b-c071-4463-b7a5-7733d54718e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020b2e4f-a95e-4179-af42-45f4c6dc5a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020b2e4f-a95e-4179-af42-45f4c6dc5a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:24:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-918682489',display_name='tempest-VolumesGetTest-Volume-355029495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6469dcf5-d599-4c83-a9e6-85b27d3d529b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e0f72ddd2b49b6a48b2a7f591eefb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:24:11Z,use_quota=True,user_id='fedf312e51d5407da2c070fb792ade6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca1d84a-b7e5-4ebe-bcf4-b6e0e7f4f5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca1d84a-b7e5-4ebe-bcf4-b6e0e7f4f5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946727db-fc0d-46b6-85b3-521935cd32fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946727db-fc0d-46b6-85b3-521935cd32fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6469dcf5-d599-4c83-a9e6-85b27d3d529b', 'volume_name': 'volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b72c02e-73db-44f2-9992-07f2863af094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b72c02e-73db-44f2-9992-07f2863af094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3a2725-2c08-475b-b986-63e394dfa745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:11 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Volume 6469dcf5-d599-4c83-a9e6-85b27d3d529b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b', 'volume_size': 1} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:24:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-918682489',display_name='tempest-VolumesGetTest-Volume-355029495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6469dcf5-d599-4c83-a9e6-85b27d3d529b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e0f72ddd2b49b6a48b2a7f591eefb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:24:11Z,use_quota=True,user_id='fedf312e51d5407da2c070fb792ade6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Creating volume 6469dcf5-d599-4c83-a9e6-85b27d3d529b {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:24:11 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-8c9ae10c-6983-437d-b982-a903b0c28771 req-fefd0b92-9da1-4fbf-8ef4-d442cc1ac154 tempest-TestStampPattern-819129895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e990eb3-339d-41dc-9b22-97484b630d7b', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:24:11 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b 1073741824 Jul 03 01:24:11 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:11 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-8c9ae10c-6983-437d-b982-a903b0c28771 req-fefd0b92-9da1-4fbf-8ef4-d442cc1ac154 tempest-TestStampPattern-819129895 None] attachment_update completed successfully. Jul 03 01:24:12 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b 1073741824" returned: 0 in 0.822s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:12 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b Jul 03 01:24:12 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:13 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b" returned: 0 in 0.707s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:24:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3a2725-2c08-475b-b986-63e394dfa745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7038bcf4-f543-47d7-9bcd-eff57ec6c8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:13 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Volume volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b (6469dcf5-d599-4c83-a9e6-85b27d3d529b): created successfully Jul 03 01:24:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7038bcf4-f543-47d7-9bcd-eff57ec6c8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (b231b65b-c071-4463-b7a5-7733d54718e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:24:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-dfbb519a-b049-4600-a2fe-5ef3f8ee5b08 tempest-VolumesGetTest-809850360 None] Created volume successfully. Jul 03 01:24:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-6469dcf5-d599-4c83-a9e6-85b27d3d529b-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Lock "cinder-6469dcf5-d599-4c83-a9e6-85b27d3d529b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-quobyte-6469dcf5-d599-4c83-a9e6-85b27d3d529b" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-6469dcf5-d599-4c83-a9e6-85b27d3d529b" acquired by "delete_volume" :: waited 0.013s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:13 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c6ff8c-1daf-4822-8897-82c9b296cfdb]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:13 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b Jul 03 01:24:13 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:14 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b" returned: 0 in 0.792s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:14 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b Jul 03 01:24:14 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:15 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6469dcf5-d599-4c83-a9e6-85b27d3d529b" returned: 0 in 0.636s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-6469dcf5-d599-4c83-a9e6-85b27d3d529b" released by "delete_volume" :: held 1.464s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:15 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Created reservations ['784ae242-506c-442c-85ad-cfaed1513ffb', '95e5b178-7f48-408e-ab18-65ba40a8dee8', '2b45fe4c-5b94-4b02-bc22-311bdada14c5', '64fb17b3-68b0-41f5-b669-6d3e3b839f66'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:24:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:15 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:24:15 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-06ebcb5f-cdcc-48f4-97d3-de46796ce527-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Lock "cinder-06ebcb5f-cdcc-48f4-97d3-de46796ce527-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:16 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.714s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:16 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:24:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-quobyte-06ebcb5f-cdcc-48f4-97d3-de46796ce527" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:16 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Deleted volume successfully. Jul 03 01:24:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-06ebcb5f-cdcc-48f4-97d3-de46796ce527" acquired by "delete_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b6ea3e21-dd52-4581-8f5a-0640688a7f04 tempest-VolumesGetTest-809850360 None] Lock "cinder-6469dcf5-d599-4c83-a9e6-85b27d3d529b-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:16 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56bde70-993d-4719-ac3b-a97b9141694e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:16 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527 Jul 03 01:24:16 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:16 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527" returned: 0 in 0.784s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:16 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527 Jul 03 01:24:16 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:17 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-06ebcb5f-cdcc-48f4-97d3-de46796ce527" returned: 0 in 0.713s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-06ebcb5f-cdcc-48f4-97d3-de46796ce527" released by "delete_volume" :: held 1.537s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:17 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Created reservations ['19ae7b46-758b-4ebd-bfaa-96b70aca1ac9', '6f175c23-96d3-4b83-baca-108b692cdafd', '2a6b18f9-0a37-4584-8e6b-9b3a5898ba79', '3eb03ede-50a5-4c35-a454-43e015aac492'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:24:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:17 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:24:17 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-492ed482-d6ea-4c51-b1e1-c4adb330c730-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Lock "cinder-492ed482-d6ea-4c51-b1e1-c4adb330c730-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-quobyte-492ed482-d6ea-4c51-b1e1-c4adb330c730" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-492ed482-d6ea-4c51-b1e1-c4adb330c730" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:18 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f4dd59-2fa8-47bd-8067-228a9648bd11]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:18 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.721s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:18 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:24:18 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Deleted volume successfully. Jul 03 01:24:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-44e9df4c-e33d-489b-94c3-8ca424628876 tempest-VolumesGetTest-809850360 None] Lock "cinder-06ebcb5f-cdcc-48f4-97d3-de46796ce527-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:18 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 Jul 03 01:24:18 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:19 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730" returned: 0 in 0.766s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:19 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730 Jul 03 01:24:19 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:19 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-a2d0dc05-8834-443a-9ec9-72e9c63d5365 req-98ef246c-7689-45d2-9b6c-508c0a04a5da tempest-TestStampPattern-819129895 None] Terminate volume connection completed successfully. Jul 03 01:24:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-a2d0dc05-8834-443a-9ec9-72e9c63d5365 req-98ef246c-7689-45d2-9b6c-508c0a04a5da tempest-TestStampPattern-819129895 None] Deleting attachment 8e990eb3-339d-41dc-9b22-97484b630d7b. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:24:19 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-492ed482-d6ea-4c51-b1e1-c4adb330c730" returned: 0 in 0.656s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-492ed482-d6ea-4c51-b1e1-c4adb330c730" released by "delete_volume" :: held 1.488s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:19 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Created reservations ['b6a00630-46d9-4094-922b-6f6d88d7872e', 'c213337b-d1d5-41e4-bcea-04a8de1b542a', '37e29335-20fc-4f34-a9ed-5cae1c074fae', '0101f17e-7b46-4d0e-9388-8dd65f49c10b'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:24:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:20 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:24:20 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:20 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.663s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:20 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:24:20 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Deleted volume successfully. Jul 03 01:24:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bbbf5df3-b9b9-4dd6-ae95-12dbf7fa77f2 tempest-VolumesGetTest-809850360 None] Lock "cinder-492ed482-d6ea-4c51-b1e1-c4adb330c730-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:21 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:24:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (75ca5dae-874f-42c0-86d9-124ee8907189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:24:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5bf82b-d832-497c-8b2d-1ec048101be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5bf82b-d832-497c-8b2d-1ec048101be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1571796738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5be271-1fad-417a-9dae-c1fa7b6588f6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2e0f72ddd2b49b6a48b2a7f591eefb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:24:21Z,use_quota=True,user_id='fedf312e51d5407da2c070fb792ade6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d24528-fc11-4cb5-bec8-684170b1f549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d24528-fc11-4cb5-bec8-684170b1f549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568a7eb6-ae4e-4dd7-b440-b0876b48dd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:21 devstack cinder-volume[86357]: DEBUG cinder.image.glance [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Creating Keystone auth plugin from conf {{(pid=86357) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:24:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568a7eb6-ae4e-4dd7-b440-b0876b48dd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a5be271-1fad-417a-9dae-c1fa7b6588f6', 'volume_name': 'volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6', 'volume_size': 1, 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7645134c6d614f2bac5348098ce26f25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'created_at': datetime.datetime(2026, 7, 2, 22, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e414f445-eb75-47cf-8830-f233a751ffdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e414f445-eb75-47cf-8830-f233a751ffdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0003326-e775-49a2-a26e-888f10716ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:21 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Volume 4a5be271-1fad-417a-9dae-c1fa7b6588f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6', 'volume_size': 1, 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7645134c6d614f2bac5348098ce26f25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'created_at': datetime.datetime(2026, 7, 2, 22, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 01:24:21 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Trying to clone 4a5be271-1fad-417a-9dae-c1fa7b6588f6 from image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]). {{(pid=86357) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] Creating offline snapshot f9b36475-7a30-4a59-9204-d777b489edee of volume ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:24:22 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Image download 20.69 MB at 20.69 MB/s Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abb5f5b-5c45-4935-ac88-ef7177f294cb]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9b11d6-d26f-4563-bc7c-6d047871c1eb]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:22 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 Jul 03 01:24:22 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:22 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD Jul 03 01:24:22 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:22 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD" returned: 0 in 0.708s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Temporary image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd is fetched for user fedf312e51d5407da2c070fb792ade6f. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:24:22 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" returned: 0 in 0.798s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:22 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee 1G Jul 03 01:24:22 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4c0588-6a7d-4759-9b07-d0f34d3fc8e1]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:23 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD Jul 03 01:24:23 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:23 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD" returned: 0 in 0.728s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:23 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee 1G" returned: 0 in 0.785s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:23 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee Jul 03 01:24:23 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:24 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee" returned: 0 in 0.741s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:24 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee is being set with open permissions: ugo+rw Jul 03 01:24:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:24 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee Jul 03 01:24:24 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:25 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee" returned: 0 in 0.629s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:25 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.info Jul 03 01:24:25 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:25 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.info" returned: 0 in 0.642s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:25 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.info is being set with open permissions: ugo+rw Jul 03 01:24:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:25 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.info Jul 03 01:24:25 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:26 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.info" returned: 0 in 0.623s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.324s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.713s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1571796738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5be271-1fad-417a-9dae-c1fa7b6588f6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2e0f72ddd2b49b6a48b2a7f591eefb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:24:21Z,use_quota=True,user_id='fedf312e51d5407da2c070fb792ade6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:24:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Creating volume 4a5be271-1fad-417a-9dae-c1fa7b6588f6 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:24:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:24:26 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:24:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:26 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 1073741824 Jul 03 01:24:26 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:26 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8b52df45-424f-4b7f-b946-2fc5d2d1791a tempest-TestStampPattern-819129895 None] Create snapshot completed successfully Jul 03 01:24:27 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 1073741824" returned: 0 in 0.774s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:27 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 Jul 03 01:24:27 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:27 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6" returned: 0 in 0.659s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:27 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:24:27 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Attempting download of 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd ((None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}])) to volume 4a5be271-1fad-417a-9dae-c1fa7b6588f6. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[956c4f03-2dbe-406f-86ce-ea7deb5f4824]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_ncghxkkv {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:28 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_ncghxkkv Jul 03 01:24:28 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:28 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.653s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:24:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:24:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:24:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:24:28 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_ncghxkkv" returned: 0 in 0.769s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_ncghxkkv {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:28 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_ncghxkkv Jul 03 01:24:28 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:29 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_ncghxkkv" returned: 1 in 0.699s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_ncghxkkv' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:24:29 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[2758cd23-bcac-4a6d-aa65-74fc2cdd5243]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:29 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD Jul 03 01:24:29 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:30 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:30 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd was qcow2, converting to raw {{(pid=86357) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:24:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:30 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 Jul 03 01:24:30 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:31 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6" returned: 0 in 1.763s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:31 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0009eb74-cd1a-42d8-bfab-8cf71f0c34cd_2p8qzh3ddevstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:24:31 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Converted 112.00 MB image at 63.49 MB/s Jul 03 01:24:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:31 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 1G Jul 03 01:24:31 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:32 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 1G" returned: 0 in 0.701s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:32 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f838951-097e-48d8-a928-a233c7af0af6]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:32 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 Jul 03 01:24:32 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:33 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6" returned: 0 in 0.775s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:33 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 Jul 03 01:24:33 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:34 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6" returned: 1 in 0.749s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:24:34 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Downloaded image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd ((None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}])) to volume 4a5be271-1fad-417a-9dae-c1fa7b6588f6 successfully. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:24:34 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Temporary image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd for user fedf312e51d5407da2c070fb792ade6f is deleted. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:24:34 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Marking volume 4a5be271-1fad-417a-9dae-c1fa7b6588f6 as bootable. {{(pid=86357) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:24:34 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Copying metadata from image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd to 4a5be271-1fad-417a-9dae-c1fa7b6588f6. {{(pid=86357) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:24:34 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Creating volume glance metadata for volume 4a5be271-1fad-417a-9dae-c1fa7b6588f6 backed by image 0009eb74-cd1a-42d8-bfab-8cf71f0c34cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86357) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:24:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0003326-e775-49a2-a26e-888f10716ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6', 'volume_size': 1, 'image_id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7645134c6d614f2bac5348098ce26f25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0009eb74-cd1a-42d8-bfab-8cf71f0c34cd', 'created_at': datetime.datetime(2026, 7, 2, 22, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0009eb74-cd1a-42d8-bfab-8cf71f0c34cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6e5290-f053-47c1-8e10-1ee74b3b6967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:34 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Volume volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 (4a5be271-1fad-417a-9dae-c1fa7b6588f6): created successfully Jul 03 01:24:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6e5290-f053-47c1-8e10-1ee74b3b6967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (75ca5dae-874f-42c0-86d9-124ee8907189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:24:34 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c64a27ef-67e8-4d23-a70b-d3ae6717fa7d tempest-VolumesGetTest-809850360 None] Created volume successfully. Jul 03 01:24:35 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:24:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (ca935094-ff54-42c6-909d-2d5b5e86cca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:24:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e80304-d2cf-48ce-be7a-dbebebfb3ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e80304-d2cf-48ce-be7a-dbebebfb3ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:24:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1519745770',display_name='tempest-VolumesGetTest-Volume-1996775024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3aec738-c023-44c3-897a-00ff512de7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e0f72ddd2b49b6a48b2a7f591eefb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:24:36Z,use_quota=True,user_id='fedf312e51d5407da2c070fb792ade6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e221288-ff79-4e78-9194-1ed6d380d3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e221288-ff79-4e78-9194-1ed6d380d3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea1533b-ac54-470e-be80-70d37b96dcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea1533b-ac54-470e-be80-70d37b96dcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3aec738-c023-44c3-897a-00ff512de7bd', 'volume_name': 'volume-d3aec738-c023-44c3-897a-00ff512de7bd', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e1062f-3678-4b1b-ac4c-5b061ce4a13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e1062f-3678-4b1b-ac4c-5b061ce4a13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c633984d-7db6-4aa5-951d-484708863bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:36 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Volume d3aec738-c023-44c3-897a-00ff512de7bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3aec738-c023-44c3-897a-00ff512de7bd', 'volume_size': 1} Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:24:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1519745770',display_name='tempest-VolumesGetTest-Volume-1996775024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3aec738-c023-44c3-897a-00ff512de7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e0f72ddd2b49b6a48b2a7f591eefb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:24:36Z,use_quota=True,user_id='fedf312e51d5407da2c070fb792ade6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Creating volume d3aec738-c023-44c3-897a-00ff512de7bd {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:24:36 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d3aec738-c023-44c3-897a-00ff512de7bd 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:36 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d3aec738-c023-44c3-897a-00ff512de7bd 1073741824 Jul 03 01:24:36 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:36 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d3aec738-c023-44c3-897a-00ff512de7bd 1073741824" returned: 0 in 0.850s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d3aec738-c023-44c3-897a-00ff512de7bd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:36 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d3aec738-c023-44c3-897a-00ff512de7bd Jul 03 01:24:36 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Flow 'volume_create_manager' (8b89354f-1fd3-49e7-8654-0ef7c3560add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e6babd-97ba-4a3c-8d5a-03c3f504a29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e6babd-97ba-4a3c-8d5a-03c3f504a29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-192723362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f52541-835b-4cc2-b18c-a095500cda17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31bbb70495e64fd6a076945ecc2a4a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f9b36475-7a30-4a59-9204-d777b489edee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:24:37Z,use_quota=True,user_id='7fc217da9abb4c4587fc45025320e0e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ec7bb1-7b55-4086-81da-38d4396c00c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ec7bb1-7b55-4086-81da-38d4396c00c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f3725a-8e12-4351-b61e-f43ba07a6e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f3725a-8e12-4351-b61e-f43ba07a6e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25f52541-835b-4cc2-b18c-a095500cda17', 'volume_name': 'volume-25f52541-835b-4cc2-b18c-a095500cda17', 'volume_size': 1, 'snapshot_id': 'f9b36475-7a30-4a59-9204-d777b489edee'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbeb36bd-ec48-41f7-8d44-01b4331d7dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbeb36bd-ec48-41f7-8d44-01b4331d7dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069f8ecc-19a9-4416-9ad8-6fb79f0f0d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:37 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Volume 25f52541-835b-4cc2-b18c-a095500cda17: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25f52541-835b-4cc2-b18c-a095500cda17', 'volume_size': 1, 'snapshot_id': 'f9b36475-7a30-4a59-9204-d777b489edee'} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:37 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d3aec738-c023-44c3-897a-00ff512de7bd" returned: 0 in 0.674s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.427s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Acquiring lock "cinder-quobyte-f9b36475-7a30-4a59-9204-d777b489edee-25f52541-835b-4cc2-b18c-a095500cda17" by "_create_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c633984d-7db6-4aa5-951d-484708863bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3aec738-c023-44c3-897a-00ff512de7bd', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9aff54-7360-40f6-9d29-3b6899e70fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Lock "cinder-quobyte-f9b36475-7a30-4a59-9204-d777b489edee-25f52541-835b-4cc2-b18c-a095500cda17" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Creating volume 25f52541-835b-4cc2-b18c-a095500cda17 from snapshot f9b36475-7a30-4a59-9204-d777b489edee {{(pid=86357) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Acquiring lock "cinder-quobyte-25f52541-835b-4cc2-b18c-a095500cda17" by "_copy_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:37 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Volume volume-d3aec738-c023-44c3-897a-00ff512de7bd (d3aec738-c023-44c3-897a-00ff512de7bd): created successfully Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9aff54-7360-40f6-9d29-3b6899e70fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Flow 'volume_create_manager' (ca935094-ff54-42c6-909d-2d5b5e86cca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Lock "cinder-quobyte-25f52541-835b-4cc2-b18c-a095500cda17" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] snapshot: f9b36475-7a30-4a59-9204-d777b489edee, volume: 25f52541-835b-4cc2-b18c-a095500cda17, {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:24:37 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-263111f3-fd8c-4df4-8b70-8c0f341f7340 tempest-VolumesGetTest-809850360 None] Created volume successfully. Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc38249a-3996-4f21-85c2-01a8d7b12546]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:37 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee Jul 03 01:24:37 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-d3aec738-c023-44c3-897a-00ff512de7bd-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Lock "cinder-d3aec738-c023-44c3-897a-00ff512de7bd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-quobyte-d3aec738-c023-44c3-897a-00ff512de7bd" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-d3aec738-c023-44c3-897a-00ff512de7bd" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:38 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f05722-c0d6-4751-952e-f5906d7277e9]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d3aec738-c023-44c3-897a-00ff512de7bd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:38 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d3aec738-c023-44c3-897a-00ff512de7bd Jul 03 01:24:38 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:38 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee" returned: 0 in 0.847s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:24:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:24:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Creating direct copy from snapshot {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:24:38 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[feba1a65-d10c-4a07-939d-d00a1336c452]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:38 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 Jul 03 01:24:38 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:39 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d3aec738-c023-44c3-897a-00ff512de7bd" returned: 0 in 0.854s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d3aec738-c023-44c3-897a-00ff512de7bd {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:39 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d3aec738-c023-44c3-897a-00ff512de7bd Jul 03 01:24:39 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:39 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" returned: 0 in 0.822s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG cinder.utils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Path /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17 not found in is_blk_device check {{(pid=86357) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:39 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17 Jul 03 01:24:39 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:39 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d3aec738-c023-44c3-897a-00ff512de7bd" returned: 0 in 0.673s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-d3aec738-c023-44c3-897a-00ff512de7bd" released by "delete_volume" :: held 1.579s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Created reservations ['4c38fe9c-bf36-46f1-b235-871c961e1a77', '34769da9-4b82-4146-ac63-d56748a5898c', 'c71f2308-1fde-4652-bf37-1c18de52bae7', 'c8554c3b-18b4-4578-ac44-4ccea4bf9186'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:40 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:24:40 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-4a5be271-1fad-417a-9dae-c1fa7b6588f6-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Lock "cinder-4a5be271-1fad-417a-9dae-c1fa7b6588f6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:40 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.951s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:40 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:24:40 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Deleted volume successfully. Jul 03 01:24:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Acquiring lock "cinder-quobyte-4a5be271-1fad-417a-9dae-c1fa7b6588f6" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9ba9bdda-43b4-4f85-94e3-de19f9c29430 tempest-VolumesGetTest-809850360 None] Lock "cinder-d3aec738-c023-44c3-897a-00ff512de7bd-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-4a5be271-1fad-417a-9dae-c1fa7b6588f6" acquired by "delete_volume" :: waited 0.040s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:41 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c44996-7e2c-4b29-af81-d0c7df490e72]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:41 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 Jul 03 01:24:41 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:43 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6" returned: 0 in 2.426s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:43 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 Jul 03 01:24:43 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17" returned: 0 in 5.964s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:45 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25807a2-b38e-44a4-be4b-528c8c1d3b4a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:45 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6" returned: 1 in 2.013s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:24:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:45 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6 Jul 03 01:24:45 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:45 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 Jul 03 01:24:45 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:46 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4a5be271-1fad-417a-9dae-c1fa7b6588f6" returned: 0 in 1.090s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Lock "cinder-quobyte-4a5be271-1fad-417a-9dae-c1fa7b6588f6" released by "delete_volume" :: held 5.675s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:46 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Created reservations ['5d6e87a4-f313-4944-9d62-c86643384b36', 'c480781f-1f5d-4cd0-b3be-b009e809648c', '4be40f86-f6f5-4772-b565-de74a529c6ac', '4f350891-72c0-4a79-b4b6-edb4d1dc0342'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:24:46 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" returned: 0 in 1.467s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:46 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:24:46 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Converted 1024.00 MB image at 171.67 MB/s Jul 03 01:24:46 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17 is being set with open permissions: ugo+rw Jul 03 01:24:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:46 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17 Jul 03 01:24:46 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:47 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:24:47 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:47 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17" returned: 0 in 0.813s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Lock "cinder-quobyte-25f52541-835b-4cc2-b18c-a095500cda17" released by "_copy_volume_from_snapshot" :: held 10.038s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:47 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Lock "cinder-quobyte-f9b36475-7a30-4a59-9204-d777b489edee-25f52541-835b-4cc2-b18c-a095500cda17" released by "_create_volume_from_snapshot" :: held 10.081s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.118s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.731s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:47 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:24:47 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Deleted volume successfully. Jul 03 01:24:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069f8ecc-19a9-4416-9ad8-6fb79f0f0d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f52541-835b-4cc2-b18c-a095500cda17', 'volume_size': 1, 'snapshot_id': 'f9b36475-7a30-4a59-9204-d777b489edee'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6980e621-4069-47b1-afc1-3f3e39f1e2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-10719bc5-0610-4734-bf3e-597324c80f3b tempest-VolumesGetTest-809850360 None] Lock "cinder-4a5be271-1fad-417a-9dae-c1fa7b6588f6-delete_volume" released by "delete_volume" :: held 6.899s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:47 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Volume volume-25f52541-835b-4cc2-b18c-a095500cda17 (25f52541-835b-4cc2-b18c-a095500cda17): created successfully Jul 03 01:24:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6980e621-4069-47b1-afc1-3f3e39f1e2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Flow 'volume_create_manager' (8b89354f-1fd3-49e7-8654-0ef7c3560add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:24:47 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b74dff53-2fcb-43f7-b759-5fd0e5f49a49 tempest-TestStampPattern-819129895 None] Created volume successfully. Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Flow 'volume_create_manager' (1c1d8842-6e23-41d4-aa4d-27c9aeb900c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91b4d1c-b5ca-4f4b-b75a-7a3954daaf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91b4d1c-b5ca-4f4b-b75a-7a3954daaf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275495583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffae0088-5937-4251-bf77-6a2a48770adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7112d6d38d44659e01c4d39e7e00d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:24:52Z,use_quota=True,user_id='711de71c61b34ec09febe567e467f960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f00ce8-d465-4341-9448-abffa8101ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f00ce8-d465-4341-9448-abffa8101ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d4343d-7948-48c1-bcda-3f1d4440f8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d4343d-7948-48c1-bcda-3f1d4440f8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffae0088-5937-4251-bf77-6a2a48770adc', 'volume_name': 'volume-ffae0088-5937-4251-bf77-6a2a48770adc', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f875eb41-2cee-4adc-a40f-350935b6347e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f875eb41-2cee-4adc-a40f-350935b6347e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b35e40-aace-4ff1-91a3-bf4c6f61979e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:51 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Volume ffae0088-5937-4251-bf77-6a2a48770adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffae0088-5937-4251-bf77-6a2a48770adc', 'volume_size': 1} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275495583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffae0088-5937-4251-bf77-6a2a48770adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7112d6d38d44659e01c4d39e7e00d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:24:52Z,use_quota=True,user_id='711de71c61b34ec09febe567e467f960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Creating volume ffae0088-5937-4251-bf77-6a2a48770adc {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:24:51 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:24:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ffae0088-5937-4251-bf77-6a2a48770adc 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:51 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ffae0088-5937-4251-bf77-6a2a48770adc 1073741824 Jul 03 01:24:51 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:52 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ffae0088-5937-4251-bf77-6a2a48770adc 1073741824" returned: 0 in 1.160s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ffae0088-5937-4251-bf77-6a2a48770adc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:52 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ffae0088-5937-4251-bf77-6a2a48770adc Jul 03 01:24:52 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:53 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ffae0088-5937-4251-bf77-6a2a48770adc" returned: 0 in 0.666s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:24:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b35e40-aace-4ff1-91a3-bf4c6f61979e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffae0088-5937-4251-bf77-6a2a48770adc', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cc85b5-1eff-4195-ad2f-5e671f8b6b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:53 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Volume volume-ffae0088-5937-4251-bf77-6a2a48770adc (ffae0088-5937-4251-bf77-6a2a48770adc): created successfully Jul 03 01:24:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cc85b5-1eff-4195-ad2f-5e671f8b6b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Flow 'volume_create_manager' (1c1d8842-6e23-41d4-aa4d-27c9aeb900c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:24:53 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-0ade9957-d484-4bcf-94f7-442f7ccc19fa tempest-ProjectReaderTests-506000991 None] Created volume successfully. Jul 03 01:24:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Acquiring lock "cinder-ffae0088-5937-4251-bf77-6a2a48770adc-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Lock "cinder-ffae0088-5937-4251-bf77-6a2a48770adc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Acquiring lock "cinder-quobyte-ffae0088-5937-4251-bf77-6a2a48770adc" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:54 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Lock "cinder-quobyte-ffae0088-5937-4251-bf77-6a2a48770adc" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:54 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e089285-76d5-43c1-ab48-2069fbf93f0b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ffae0088-5937-4251-bf77-6a2a48770adc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:54 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ffae0088-5937-4251-bf77-6a2a48770adc Jul 03 01:24:54 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:54 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ffae0088-5937-4251-bf77-6a2a48770adc" returned: 0 in 0.818s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ffae0088-5937-4251-bf77-6a2a48770adc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:54 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ffae0088-5937-4251-bf77-6a2a48770adc Jul 03 01:24:54 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:55 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ffae0088-5937-4251-bf77-6a2a48770adc" returned: 0 in 0.748s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Lock "cinder-quobyte-ffae0088-5937-4251-bf77-6a2a48770adc" released by "delete_volume" :: held 1.612s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:55 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Created reservations ['d6b5d374-477e-4078-87aa-397982b46d38', '98462a45-f4b0-4646-94a2-918c41eca466', '1b29a5b0-0c2a-486d-94a6-abbb95b51eac', '31f81c02-bdf0-4de0-9354-601db24f4d21'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:24:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:55 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:24:55 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:56 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.720s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:24:56 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Deleted volume successfully. Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6efff26b-6a53-4f4c-86e4-0d300d3aaf68 tempest-ProjectReaderTests-506000991 None] Lock "cinder-ffae0088-5937-4251-bf77-6a2a48770adc-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Flow 'volume_create_manager' (a8594d8e-9d9d-4712-bffd-39f132940b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c288e660-7a99-48dd-9b27-5fc4ef56b6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c288e660-7a99-48dd-9b27-5fc4ef56b6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072916565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a7b219-d79c-43e4-8150-3e4433cb5a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7112d6d38d44659e01c4d39e7e00d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:24:57Z,use_quota=True,user_id='711de71c61b34ec09febe567e467f960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b13e36c-77c6-4874-8b97-a0edb9a84eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b13e36c-77c6-4874-8b97-a0edb9a84eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4ebf6c-e77a-4c0c-a439-243a1c7df4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4ebf6c-e77a-4c0c-a439-243a1c7df4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6a7b219-d79c-43e4-8150-3e4433cb5a07', 'volume_name': 'volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d53278-2adc-4b6d-a303-84bca801774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d53278-2adc-4b6d-a303-84bca801774a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489ff4a8-273f-4e30-b27b-22e38139dc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:56 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Volume e6a7b219-d79c-43e4-8150-3e4433cb5a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07', 'volume_size': 1} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072916565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a7b219-d79c-43e4-8150-3e4433cb5a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7112d6d38d44659e01c4d39e7e00d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:24:57Z,use_quota=True,user_id='711de71c61b34ec09febe567e467f960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Creating volume e6a7b219-d79c-43e4-8150-3e4433cb5a07 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:24:56 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:24:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:56 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07 1073741824 Jul 03 01:24:56 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:57 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07 1073741824" returned: 0 in 1.001s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:57 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07 Jul 03 01:24:57 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:58 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07" returned: 0 in 0.669s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:24:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489ff4a8-273f-4e30-b27b-22e38139dc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8e5868-5390-4c88-bdd4-288a2072b968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:24:58 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Volume volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07 (e6a7b219-d79c-43e4-8150-3e4433cb5a07): created successfully Jul 03 01:24:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8e5868-5390-4c88-bdd4-288a2072b968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:24:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Flow 'volume_create_manager' (a8594d8e-9d9d-4712-bffd-39f132940b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:24:58 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-930da978-21f9-43c9-acdb-a7e9bac74ace tempest-ProjectReaderTests-506000991 None] Created volume successfully. Jul 03 01:24:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Acquiring lock "cinder-e6a7b219-d79c-43e4-8150-3e4433cb5a07-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Lock "cinder-e6a7b219-d79c-43e4-8150-3e4433cb5a07-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Acquiring lock "cinder-quobyte-e6a7b219-d79c-43e4-8150-3e4433cb5a07" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:59 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Lock "cinder-quobyte-e6a7b219-d79c-43e4-8150-3e4433cb5a07" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:59 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5412c31-0e03-4e3e-9f0d-3e9388ddba31]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:59 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07 Jul 03 01:24:59 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:59 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07" returned: 0 in 0.818s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:59 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07 Jul 03 01:24:59 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:00 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e6a7b219-d79c-43e4-8150-3e4433cb5a07" returned: 0 in 0.665s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:00 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Lock "cinder-quobyte-e6a7b219-d79c-43e4-8150-3e4433cb5a07" released by "delete_volume" :: held 1.532s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:00 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Created reservations ['92fb4b35-3ffd-4a8d-9d44-2639bb92cf4f', '462fc09d-aa50-4161-be88-d4eff833c127', '3c7abede-0b93-4303-a0a3-b6bd5de4f0ff', 'edad90ff-1a25-4e83-95d7-1fbe94d32c1e'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:00 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:25:00 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:01 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.707s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:01 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:01 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Deleted volume successfully. Jul 03 01:25:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2d849e63-6d25-4822-964d-601d5fc2761f tempest-ProjectReaderTests-506000991 None] Lock "cinder-e6a7b219-d79c-43e4-8150-3e4433cb5a07-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:10 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=85,cinder:SELECT=66,cinder:INSERT=25,cinder:DELETE=4 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:25:11 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=67,cinder:UPDATE=77,cinder:INSERT=23,cinder:DELETE=11 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Flow 'volume_create_manager' (b750f685-4083-4e02-8e94-8920a5c6cb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f91a75a-bed2-4dc0-a8cc-59f6d32715b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f91a75a-bed2-4dc0-a8cc-59f6d32715b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234092973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d59771f-c928-424f-a3e4-af102df5eb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640db03fe3ad4910a54f205594f440b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:13Z,use_quota=True,user_id='ea13a68794f74c3da731d76c161970b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e6867c-fe2f-4b5b-8584-3d0382f738da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e6867c-fe2f-4b5b-8584-3d0382f738da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4e6d3c-92d4-4766-8475-85f368a1f5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4e6d3c-92d4-4766-8475-85f368a1f5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d59771f-c928-424f-a3e4-af102df5eb98', 'volume_name': 'volume-2d59771f-c928-424f-a3e4-af102df5eb98', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b4824e-7fe4-42b8-9c59-0ebfc5a9c7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b4824e-7fe4-42b8-9c59-0ebfc5a9c7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e13b94-30e3-4dfe-87b2-50c3df70ff90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:13 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Volume 2d59771f-c928-424f-a3e4-af102df5eb98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d59771f-c928-424f-a3e4-af102df5eb98', 'volume_size': 1} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234092973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d59771f-c928-424f-a3e4-af102df5eb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640db03fe3ad4910a54f205594f440b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:13Z,use_quota=True,user_id='ea13a68794f74c3da731d76c161970b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Creating volume 2d59771f-c928-424f-a3e4-af102df5eb98 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:25:13 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:25:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2d59771f-c928-424f-a3e4-af102df5eb98 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:13 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2d59771f-c928-424f-a3e4-af102df5eb98 1073741824 Jul 03 01:25:13 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:14 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2d59771f-c928-424f-a3e4-af102df5eb98 1073741824" returned: 0 in 0.782s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2d59771f-c928-424f-a3e4-af102df5eb98 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:14 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2d59771f-c928-424f-a3e4-af102df5eb98 Jul 03 01:25:14 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:14 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2d59771f-c928-424f-a3e4-af102df5eb98" returned: 0 in 0.630s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:25:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e13b94-30e3-4dfe-87b2-50c3df70ff90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d59771f-c928-424f-a3e4-af102df5eb98', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77aed47f-037f-4526-b299-412e00049bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:14 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Volume volume-2d59771f-c928-424f-a3e4-af102df5eb98 (2d59771f-c928-424f-a3e4-af102df5eb98): created successfully Jul 03 01:25:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77aed47f-037f-4526-b299-412e00049bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Flow 'volume_create_manager' (b750f685-4083-4e02-8e94-8920a5c6cb08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:14 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1d890bf1-a93d-4d67-9647-52700ef05d99 tempest-ProjectReaderTests-1655748933 None] Created volume successfully. Jul 03 01:25:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "cinder-2d59771f-c928-424f-a3e4-af102df5eb98-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Lock "cinder-2d59771f-c928-424f-a3e4-af102df5eb98-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "cinder-quobyte-2d59771f-c928-424f-a3e4-af102df5eb98" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Lock "cinder-quobyte-2d59771f-c928-424f-a3e4-af102df5eb98" acquired by "delete_volume" :: waited 0.014s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:15 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bdf7d4-88a9-47fe-bfdf-ffa34caa8b5c]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2d59771f-c928-424f-a3e4-af102df5eb98 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:15 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2d59771f-c928-424f-a3e4-af102df5eb98 Jul 03 01:25:15 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:16 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2d59771f-c928-424f-a3e4-af102df5eb98" returned: 0 in 0.752s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2d59771f-c928-424f-a3e4-af102df5eb98 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:16 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2d59771f-c928-424f-a3e4-af102df5eb98 Jul 03 01:25:16 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:17 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2d59771f-c928-424f-a3e4-af102df5eb98" returned: 0 in 0.701s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Lock "cinder-quobyte-2d59771f-c928-424f-a3e4-af102df5eb98" released by "delete_volume" :: held 1.491s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:17 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Created reservations ['3cf549b7-ca84-4c05-8660-08802aea565e', '29146dca-2848-483d-9a81-939a3084e3d0', '0f602055-2c71-40f0-957e-fc7146ecbd3c', 'bc0a9f81-1f8f-4f43-a7fc-04d8deb63b52'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:17 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:25:17 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:17 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.687s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:17 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:17 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Deleted volume successfully. Jul 03 01:25:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-6b976b3c-ef54-4e1f-97e7-e181cf3aeec4 tempest-ProjectReaderTests-1655748933 None] Lock "cinder-2d59771f-c928-424f-a3e4-af102df5eb98-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Flow 'volume_create_manager' (3e25ca04-5046-4c56-879d-b47ce24a52e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125cbfb1-7955-4b68-9f33-d3dddf5be0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125cbfb1-7955-4b68-9f33-d3dddf5be0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-142990727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f968800c-e359-4fc8-8273-0f55c75b8391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640db03fe3ad4910a54f205594f440b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:18Z,use_quota=True,user_id='ea13a68794f74c3da731d76c161970b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c72471-1b9d-4a16-a39a-ce6e2ebecdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c72471-1b9d-4a16-a39a-ce6e2ebecdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a5a92c-9655-462a-80ae-13cb13925791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a5a92c-9655-462a-80ae-13cb13925791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f968800c-e359-4fc8-8273-0f55c75b8391', 'volume_name': 'volume-f968800c-e359-4fc8-8273-0f55c75b8391', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc6cbbe-818f-4288-9b22-c7471c051060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc6cbbe-818f-4288-9b22-c7471c051060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e65adf5-1a1e-419d-8e84-0e5b7328d6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:18 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Volume f968800c-e359-4fc8-8273-0f55c75b8391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f968800c-e359-4fc8-8273-0f55c75b8391', 'volume_size': 1} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-142990727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f968800c-e359-4fc8-8273-0f55c75b8391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640db03fe3ad4910a54f205594f440b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:18Z,use_quota=True,user_id='ea13a68794f74c3da731d76c161970b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Creating volume f968800c-e359-4fc8-8273-0f55c75b8391 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:25:18 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:25:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f968800c-e359-4fc8-8273-0f55c75b8391 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:18 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f968800c-e359-4fc8-8273-0f55c75b8391 1073741824 Jul 03 01:25:18 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:19 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f968800c-e359-4fc8-8273-0f55c75b8391 1073741824" returned: 0 in 0.790s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f968800c-e359-4fc8-8273-0f55c75b8391 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:19 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f968800c-e359-4fc8-8273-0f55c75b8391 Jul 03 01:25:19 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:19 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f968800c-e359-4fc8-8273-0f55c75b8391" returned: 0 in 0.645s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:25:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e65adf5-1a1e-419d-8e84-0e5b7328d6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f968800c-e359-4fc8-8273-0f55c75b8391', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3487b30-57c5-426a-95b9-192d8133eeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:19 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Volume volume-f968800c-e359-4fc8-8273-0f55c75b8391 (f968800c-e359-4fc8-8273-0f55c75b8391): created successfully Jul 03 01:25:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3487b30-57c5-426a-95b9-192d8133eeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Flow 'volume_create_manager' (3e25ca04-5046-4c56-879d-b47ce24a52e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:19 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-761cf152-8605-4981-92eb-c9e4742faea4 tempest-ProjectReaderTests-1655748933 None] Created volume successfully. Jul 03 01:25:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "cinder-f968800c-e359-4fc8-8273-0f55c75b8391-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Lock "cinder-f968800c-e359-4fc8-8273-0f55c75b8391-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "cinder-quobyte-f968800c-e359-4fc8-8273-0f55c75b8391" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Lock "cinder-quobyte-f968800c-e359-4fc8-8273-0f55c75b8391" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:20 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[030a0f67-a51b-4b75-abba-3a7b2f10f37c]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f968800c-e359-4fc8-8273-0f55c75b8391 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:20 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f968800c-e359-4fc8-8273-0f55c75b8391 Jul 03 01:25:20 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-039a7850-1a78-4277-89a1-60e847c1d8c5 req-82d48c93-d2bf-455e-bc38-412053be00b5 tempest-TestStampPattern-819129895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-039a7850-1a78-4277-89a1-60e847c1d8c5 req-82d48c93-d2bf-455e-bc38-412053be00b5 tempest-TestStampPattern-819129895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3664e4f2-c6ba-4b7d-919d-0912b6818cf7]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-039a7850-1a78-4277-89a1-60e847c1d8c5 req-82d48c93-d2bf-455e-bc38-412053be00b5 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:21 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f968800c-e359-4fc8-8273-0f55c75b8391" returned: 0 in 0.760s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f968800c-e359-4fc8-8273-0f55c75b8391 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:21 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f968800c-e359-4fc8-8273-0f55c75b8391 Jul 03 01:25:21 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:21 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17 Jul 03 01:25:21 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:21 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f968800c-e359-4fc8-8273-0f55c75b8391" returned: 0 in 0.630s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Lock "cinder-quobyte-f968800c-e359-4fc8-8273-0f55c75b8391" released by "delete_volume" :: held 1.441s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Created reservations ['b86ba943-f880-47cc-989d-251ad56ba31c', '42bdc62e-0d20-4023-b340-69db483c2011', '34fcd58b-30d9-44c4-adff-91c0a0a76890', '0c41a413-a328-46b7-86fe-ca5116967ee8'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:21 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [req-039a7850-1a78-4277-89a1-60e847c1d8c5 req-82d48c93-d2bf-455e-bc38-412053be00b5 tempest-TestStampPattern-819129895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17" returned: 0 in 0.790s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [req-039a7850-1a78-4277-89a1-60e847c1d8c5 req-82d48c93-d2bf-455e-bc38-412053be00b5 tempest-TestStampPattern-819129895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.808s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:22 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:25:22 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-039a7850-1a78-4277-89a1-60e847c1d8c5 req-82d48c93-d2bf-455e-bc38-412053be00b5 tempest-TestStampPattern-819129895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a', 'name': 'volume-25f52541-835b-4cc2-b18c-a095500cda17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a19f836-659a-4821-9bca-8748ed321473', 'enforce_multipath': True} {{(pid=86357) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:25:22 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-039a7850-1a78-4277-89a1-60e847c1d8c5 req-82d48c93-d2bf-455e-bc38-412053be00b5 tempest-TestStampPattern-819129895 None] attachment_update completed successfully. Jul 03 01:25:22 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.653s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:22 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:22 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Deleted volume successfully. Jul 03 01:25:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4487d4c9-9797-40c4-ae7a-f5a764d7cc36 tempest-ProjectReaderTests-1655748933 None] Lock "cinder-f968800c-e359-4fc8-8273-0f55c75b8391-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Flow 'volume_create_manager' (84a936ca-25d7-4c0d-825c-b8fa01d624cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4669ff75-2131-4073-912e-90780880349c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4669ff75-2131-4073-912e-90780880349c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1459180188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada74d37-fd64-402a-a7ff-61029745d2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640db03fe3ad4910a54f205594f440b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:23Z,use_quota=True,user_id='ea13a68794f74c3da731d76c161970b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79bac8bd-e923-406b-9f59-e2a97a3081e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79bac8bd-e923-406b-9f59-e2a97a3081e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1ca740-590d-4daa-a330-39f029ffee6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1ca740-590d-4daa-a330-39f029ffee6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada74d37-fd64-402a-a7ff-61029745d2ba', 'volume_name': 'volume-ada74d37-fd64-402a-a7ff-61029745d2ba', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340ced00-586c-4ad1-aef9-f2c2c3e40900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340ced00-586c-4ad1-aef9-f2c2c3e40900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21348bf-57c9-40cc-901c-13db875f9e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:23 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Volume ada74d37-fd64-402a-a7ff-61029745d2ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada74d37-fd64-402a-a7ff-61029745d2ba', 'volume_size': 1} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1459180188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada74d37-fd64-402a-a7ff-61029745d2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640db03fe3ad4910a54f205594f440b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:23Z,use_quota=True,user_id='ea13a68794f74c3da731d76c161970b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Creating volume ada74d37-fd64-402a-a7ff-61029745d2ba {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:25:23 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ada74d37-fd64-402a-a7ff-61029745d2ba 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:23 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ada74d37-fd64-402a-a7ff-61029745d2ba 1073741824 Jul 03 01:25:23 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:23 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ada74d37-fd64-402a-a7ff-61029745d2ba 1073741824" returned: 0 in 0.801s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ada74d37-fd64-402a-a7ff-61029745d2ba {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:23 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ada74d37-fd64-402a-a7ff-61029745d2ba Jul 03 01:25:23 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:24 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ada74d37-fd64-402a-a7ff-61029745d2ba" returned: 0 in 0.621s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:25:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21348bf-57c9-40cc-901c-13db875f9e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada74d37-fd64-402a-a7ff-61029745d2ba', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8fa2a4-331b-4ccc-bb6d-fbe76536397e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:24 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Volume volume-ada74d37-fd64-402a-a7ff-61029745d2ba (ada74d37-fd64-402a-a7ff-61029745d2ba): created successfully Jul 03 01:25:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8fa2a4-331b-4ccc-bb6d-fbe76536397e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:24 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Flow 'volume_create_manager' (84a936ca-25d7-4c0d-825c-b8fa01d624cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:24 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-15b0aa3f-084e-41a6-ae53-b24106d5ada8 tempest-ProjectReaderTests-1655748933 None] Created volume successfully. Jul 03 01:25:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "cinder-ada74d37-fd64-402a-a7ff-61029745d2ba-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Lock "cinder-ada74d37-fd64-402a-a7ff-61029745d2ba-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "cinder-quobyte-ada74d37-fd64-402a-a7ff-61029745d2ba" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Lock "cinder-quobyte-ada74d37-fd64-402a-a7ff-61029745d2ba" acquired by "delete_volume" :: waited 0.014s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:25 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7c2e8f-61b8-4419-8549-9eba861f83bc]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ada74d37-fd64-402a-a7ff-61029745d2ba {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:25 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ada74d37-fd64-402a-a7ff-61029745d2ba Jul 03 01:25:25 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:25 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ada74d37-fd64-402a-a7ff-61029745d2ba" returned: 0 in 0.735s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ada74d37-fd64-402a-a7ff-61029745d2ba {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:25 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ada74d37-fd64-402a-a7ff-61029745d2ba Jul 03 01:25:25 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:26 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ada74d37-fd64-402a-a7ff-61029745d2ba" returned: 0 in 0.647s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Lock "cinder-quobyte-ada74d37-fd64-402a-a7ff-61029745d2ba" released by "delete_volume" :: held 1.419s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:26 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Created reservations ['349b3fc0-65a8-4c54-8bb5-4ecb9fcfc5e0', '0a2f5691-0062-4589-96ac-f0e1fc697273', '3fb9ba27-8f75-4cd9-9b99-dad3f1cc4507', '47d859b2-200e-4b7d-9cfd-7edea6cad3ba'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:26 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:25:26 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:27 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.668s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:27 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Deleted volume successfully. Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1fbb0416-5e95-476a-9d9c-74dd57b73d99 tempest-ProjectReaderTests-1655748933 None] Lock "cinder-ada74d37-fd64-402a-a7ff-61029745d2ba-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Flow 'volume_create_manager' (6c865bab-7cc3-4f4c-860c-2c3c3b329fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97925cda-1cad-4959-9bec-30c5bc739e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:27 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:25:27 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97925cda-1cad-4959-9bec-30c5bc739e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1550988237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721622da-257d-45a5-a77c-31bc1c297abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640db03fe3ad4910a54f205594f440b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:28Z,use_quota=True,user_id='ea13a68794f74c3da731d76c161970b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3222721-6e30-40d5-a45e-7d7bfa3b37bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3222721-6e30-40d5-a45e-7d7bfa3b37bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27187772-ab9a-4214-b80c-9d40a36088d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27187772-ab9a-4214-b80c-9d40a36088d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '721622da-257d-45a5-a77c-31bc1c297abf', 'volume_name': 'volume-721622da-257d-45a5-a77c-31bc1c297abf', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd3a2e6-3b29-43f9-902e-b40a9348b18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd3a2e6-3b29-43f9-902e-b40a9348b18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e3c5e1-50d6-4eee-94bb-98616c8f1233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:27 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Volume 721622da-257d-45a5-a77c-31bc1c297abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-721622da-257d-45a5-a77c-31bc1c297abf', 'volume_size': 1} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1550988237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721622da-257d-45a5-a77c-31bc1c297abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640db03fe3ad4910a54f205594f440b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:28Z,use_quota=True,user_id='ea13a68794f74c3da731d76c161970b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Creating volume 721622da-257d-45a5-a77c-31bc1c297abf {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:25:27 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:25:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-721622da-257d-45a5-a77c-31bc1c297abf 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:27 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-721622da-257d-45a5-a77c-31bc1c297abf 1073741824 Jul 03 01:25:27 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:28 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.674s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:25:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:25:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:25:28 devstack cinder-volume[86357]: INFO cinder.volume.manager [req-2c26ffdc-317d-40db-82d6-e8fc89cbe3fc req-61a1103e-b98f-4d87-8702-50522efc98e3 tempest-TestStampPattern-819129895 None] Terminate volume connection completed successfully. Jul 03 01:25:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [req-2c26ffdc-317d-40db-82d6-e8fc89cbe3fc req-61a1103e-b98f-4d87-8702-50522efc98e3 tempest-TestStampPattern-819129895 None] Deleting attachment 3a19f836-659a-4821-9bca-8748ed321473. {{(pid=86357) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:25:28 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-721622da-257d-45a5-a77c-31bc1c297abf 1073741824" returned: 0 in 0.875s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-721622da-257d-45a5-a77c-31bc1c297abf {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:28 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-721622da-257d-45a5-a77c-31bc1c297abf Jul 03 01:25:28 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:29 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-721622da-257d-45a5-a77c-31bc1c297abf" returned: 0 in 0.627s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:29 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:25:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e3c5e1-50d6-4eee-94bb-98616c8f1233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-721622da-257d-45a5-a77c-31bc1c297abf', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea82b83-dcc5-41bf-82ad-f48eab8eb6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:29 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Volume volume-721622da-257d-45a5-a77c-31bc1c297abf (721622da-257d-45a5-a77c-31bc1c297abf): created successfully Jul 03 01:25:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea82b83-dcc5-41bf-82ad-f48eab8eb6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Flow 'volume_create_manager' (6c865bab-7cc3-4f4c-860c-2c3c3b329fd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:29 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-5cc18afe-cadd-4cf0-ba13-1b5eb025503d tempest-ProjectReaderTests-1655748933 None] Created volume successfully. Jul 03 01:25:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Acquiring lock "cinder-721622da-257d-45a5-a77c-31bc1c297abf-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Lock "cinder-721622da-257d-45a5-a77c-31bc1c297abf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Acquiring lock "cinder-quobyte-721622da-257d-45a5-a77c-31bc1c297abf" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Lock "cinder-quobyte-721622da-257d-45a5-a77c-31bc1c297abf" acquired by "delete_volume" :: waited 0.012s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:29 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d70caf2-1116-4911-bf6c-4f8ac4823ce2]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-721622da-257d-45a5-a77c-31bc1c297abf {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:30 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-721622da-257d-45a5-a77c-31bc1c297abf Jul 03 01:25:30 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:30 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-721622da-257d-45a5-a77c-31bc1c297abf" returned: 0 in 0.749s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-721622da-257d-45a5-a77c-31bc1c297abf {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:30 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-721622da-257d-45a5-a77c-31bc1c297abf Jul 03 01:25:30 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:31 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-721622da-257d-45a5-a77c-31bc1c297abf" returned: 0 in 0.711s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Lock "cinder-quobyte-721622da-257d-45a5-a77c-31bc1c297abf" released by "delete_volume" :: held 1.506s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:31 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Created reservations ['2b67b369-827f-458a-a6e2-d5a683c460b2', 'af1f3327-540e-4292-b917-606b45840e77', '0060ec67-7ea3-477e-840e-95498e4bbde1', '4d05ea28-13c5-4948-a5ef-ef8a282d23a7'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:31 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:25:31 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:32 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.695s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:32 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:32 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Deleted volume successfully. Jul 03 01:25:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-44ad162a-b3f7-4df2-8ffe-caee9265dfdc tempest-ProjectReaderTests-1655748933 None] Lock "cinder-721622da-257d-45a5-a77c-31bc1c297abf-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Acquiring lock "cinder-25f52541-835b-4cc2-b18c-a095500cda17-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Lock "cinder-25f52541-835b-4cc2-b18c-a095500cda17-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Acquiring lock "cinder-quobyte-25f52541-835b-4cc2-b18c-a095500cda17" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Lock "cinder-quobyte-25f52541-835b-4cc2-b18c-a095500cda17" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:37 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b96382-c194-4b77-94b0-c90381d33b6b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:37 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17 Jul 03 01:25:37 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:38 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17" returned: 0 in 0.756s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:38 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17 Jul 03 01:25:38 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:39 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-25f52541-835b-4cc2-b18c-a095500cda17" returned: 0 in 0.655s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Lock "cinder-quobyte-25f52541-835b-4cc2-b18c-a095500cda17" released by "delete_volume" :: held 1.450s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:39 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Created reservations ['1decdcc2-19d0-406d-8602-bd80905aa25e', 'e56d63cb-ab9a-4b56-ac38-299da27b4509', '9a0e0406-ac9b-43bd-895f-573872dabbc4', 'f8feff47-5693-489f-9290-6d35d4cf3e8b'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:39 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:25:39 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:40 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.651s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:40 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:40 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Deleted volume successfully. Jul 03 01:25:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-3c57adf8-3ff1-4a52-9b4b-97a722721872 tempest-TestStampPattern-819129895 None] Lock "cinder-25f52541-835b-4cc2-b18c-a095500cda17-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Acquiring lock "cinder-f9b36475-7a30-4a59-9204-d777b489edee-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Lock "cinder-f9b36475-7a30-4a59-9204-d777b489edee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Acquiring lock "cinder-quobyte-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Lock "cinder-quobyte-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Acquiring lock "cinder-quobyte-f9b36475-7a30-4a59-9204-d777b489edee" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Lock "cinder-quobyte-f9b36475-7a30-4a59-9204-d777b489edee" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Deleting offline snapshot f9b36475-7a30-4a59-9204-d777b489edee of volume ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:25:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] snapshot_file for this snap is: volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:25:40 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ecb73a-9e86-4fe7-8764-b6c415cab5fa]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:40 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee Jul 03 01:25:40 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:41 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee" returned: 0 in 0.751s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:25:41 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[65568999-c680-4250-8e4a-3a806a6d329f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:41 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 Jul 03 01:25:41 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:41 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" returned: 0 in 0.755s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:41 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee Jul 03 01:25:41 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:42 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee" returned: 0 in 0.734s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:42 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee Jul 03 01:25:42 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:43 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6.f9b36475-7a30-4a59-9204-d777b489edee" returned: 0 in 0.637s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Lock "cinder-quobyte-f9b36475-7a30-4a59-9204-d777b489edee" released by "_delete_snapshot" :: held 2.971s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Lock "cinder-quobyte-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" released by "delete_snapshot" :: held 2.992s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:43 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Created reservations ['cf2f5dcb-d2b2-46ef-9d1c-32484a62141d', '33b3948c-dd5a-446c-8a10-3c786c69c2df', '0e54ec96-c1ce-4929-be72-5d31772cf7f4', '4d5ec94c-89de-4974-b4c7-22d38fa77b51'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:43 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Delete snapshot completed successfully. Jul 03 01:25:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f07d1da7-f96f-438b-8340-6ee204660511 tempest-TestStampPattern-819129895 None] Lock "cinder-f9b36475-7a30-4a59-9204-d777b489edee-delete_snapshot" released by "delete_snapshot" :: held 3.140s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Acquiring lock "cinder-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Lock "cinder-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Acquiring lock "cinder-quobyte-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Lock "cinder-quobyte-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" acquired by "delete_volume" :: waited 0.013s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:52 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[402d96cc-cef9-4af3-8ca9-81974e3336cd]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:52 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 Jul 03 01:25:52 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:53 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" returned: 0 in 0.743s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:53 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6 Jul 03 01:25:53 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:53 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" returned: 0 in 0.619s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:54 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Lock "cinder-quobyte-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6" released by "delete_volume" :: held 1.421s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:54 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Created reservations ['976fa77e-56ed-4b43-a227-9e566235be08', 'ce6b499c-9c7e-4c62-a030-9d3c43c28729', '323efd1e-c2c6-48ab-8108-ba1637350d84', 'c195065e-7aea-43ea-8608-10f26dd2dfb0'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:54 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:25:54 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:54 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.621s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:54 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:54 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Deleted volume successfully. Jul 03 01:25:54 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-616098bf-0259-4a67-b5ba-ffb4a6c8fd5e tempest-TestStampPattern-819129895 None] Lock "cinder-ae1ac65a-2f5d-4b0a-afcc-eec446a645d6-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=63,cinder:SELECT=51,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Flow 'volume_create_manager' (4918ed20-560c-46df-84b9-1169827461b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9452feb5-503f-4ee2-989c-f409d8f59f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9452feb5-503f-4ee2-989c-f409d8f59f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-740711680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42da1e6-80aa-4107-b8f0-ff983919b983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea8cbf5374d4e71a59d494dc5cf8ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:04Z,use_quota=True,user_id='d910714ad71b4e3dae3c0d9e01d5a0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a95894-95af-43b2-bcb1-e6861cd30d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a95894-95af-43b2-bcb1-e6861cd30d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a8b9a2-5345-4dc7-9b1d-b2e2b69cefa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a8b9a2-5345-4dc7-9b1d-b2e2b69cefa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e42da1e6-80aa-4107-b8f0-ff983919b983', 'volume_name': 'volume-e42da1e6-80aa-4107-b8f0-ff983919b983', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5b18e8-dd1f-40bc-8027-7d1b4bc1f3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5b18e8-dd1f-40bc-8027-7d1b4bc1f3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137ec4bb-3af9-450f-845d-0b77025b9498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:04 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume e42da1e6-80aa-4107-b8f0-ff983919b983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e42da1e6-80aa-4107-b8f0-ff983919b983', 'volume_size': 1} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-740711680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42da1e6-80aa-4107-b8f0-ff983919b983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea8cbf5374d4e71a59d494dc5cf8ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:04Z,use_quota=True,user_id='d910714ad71b4e3dae3c0d9e01d5a0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Creating volume e42da1e6-80aa-4107-b8f0-ff983919b983 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:04 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:26:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e42da1e6-80aa-4107-b8f0-ff983919b983 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:04 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e42da1e6-80aa-4107-b8f0-ff983919b983 1073741824 Jul 03 01:26:04 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:05 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e42da1e6-80aa-4107-b8f0-ff983919b983 1073741824" returned: 0 in 0.801s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e42da1e6-80aa-4107-b8f0-ff983919b983 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:05 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e42da1e6-80aa-4107-b8f0-ff983919b983 Jul 03 01:26:05 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:06 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e42da1e6-80aa-4107-b8f0-ff983919b983" returned: 0 in 0.638s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137ec4bb-3af9-450f-845d-0b77025b9498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e42da1e6-80aa-4107-b8f0-ff983919b983', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f878504-85bd-4e25-8211-565c6727dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:06 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume volume-e42da1e6-80aa-4107-b8f0-ff983919b983 (e42da1e6-80aa-4107-b8f0-ff983919b983): created successfully Jul 03 01:26:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f878504-85bd-4e25-8211-565c6727dec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Flow 'volume_create_manager' (4918ed20-560c-46df-84b9-1169827461b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:06 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-993dfd94-a170-4076-b772-e42c64b02bcb tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Created volume successfully. Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Flow 'volume_create_manager' (a97ee894-983b-4f4e-94a3-9c11d51faeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77154388-d6b7-477c-8f8c-e8f5363f4fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77154388-d6b7-477c-8f8c-e8f5363f4fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1698380672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b641e5c-051a-4b67-8174-0d131bce6e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea8cbf5374d4e71a59d494dc5cf8ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:07Z,use_quota=True,user_id='d910714ad71b4e3dae3c0d9e01d5a0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0068b4b7-bbf5-416c-a260-ce079c3fba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0068b4b7-bbf5-416c-a260-ce079c3fba14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff181f2e-b943-4b2e-9d50-f66dbf72ee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff181f2e-b943-4b2e-9d50-f66dbf72ee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b641e5c-051a-4b67-8174-0d131bce6e22', 'volume_name': 'volume-2b641e5c-051a-4b67-8174-0d131bce6e22', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77750edb-31f4-437f-9b3c-2e4823cf7b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77750edb-31f4-437f-9b3c-2e4823cf7b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05721c0a-1b04-4da8-abd7-13d8161af4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume 2b641e5c-051a-4b67-8174-0d131bce6e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b641e5c-051a-4b67-8174-0d131bce6e22', 'volume_size': 1} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1698380672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b641e5c-051a-4b67-8174-0d131bce6e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea8cbf5374d4e71a59d494dc5cf8ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:07Z,use_quota=True,user_id='d910714ad71b4e3dae3c0d9e01d5a0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Creating volume 2b641e5c-051a-4b67-8174-0d131bce6e22 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:07 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b641e5c-051a-4b67-8174-0d131bce6e22 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:07 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b641e5c-051a-4b67-8174-0d131bce6e22 1073741824 Jul 03 01:26:07 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Flow 'volume_create_manager' (977b7970-36c7-4e1a-bec7-e66811c94d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9447619-3ae5-4531-9845-6aaef9ea928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9447619-3ae5-4531-9845-6aaef9ea928c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-297164790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94310ef-d7ea-4761-9f80-16127b047759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea8cbf5374d4e71a59d494dc5cf8ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:07Z,use_quota=True,user_id='d910714ad71b4e3dae3c0d9e01d5a0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0710bb16-ca85-4cb6-acb9-eb447278f0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0710bb16-ca85-4cb6-acb9-eb447278f0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0c68ec-c09e-435a-82ec-0abd2f4e993e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0c68ec-c09e-435a-82ec-0abd2f4e993e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94310ef-d7ea-4761-9f80-16127b047759', 'volume_name': 'volume-b94310ef-d7ea-4761-9f80-16127b047759', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274fce48-78d6-4d34-ac15-2dcd09ab121b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274fce48-78d6-4d34-ac15-2dcd09ab121b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c644199b-3eb6-41f2-ac2f-b6dd6ba02809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume b94310ef-d7ea-4761-9f80-16127b047759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94310ef-d7ea-4761-9f80-16127b047759', 'volume_size': 1} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Flow 'volume_create_manager' (9bdea8ee-558f-4c3c-a5b2-1b1002155073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce02377-be34-4b32-ae1e-51f9d753245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce02377-be34-4b32-ae1e-51f9d753245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766806445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea8cbf5374d4e71a59d494dc5cf8ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:08Z,use_quota=True,user_id='d910714ad71b4e3dae3c0d9e01d5a0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31c2674-468c-4db3-a4cd-2f90508ec178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31c2674-468c-4db3-a4cd-2f90508ec178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0c70c8-d734-4421-a4cb-0abdd250ad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0c70c8-d734-4421-a4cb-0abdd250ad03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f', 'volume_name': 'volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b449ef-99c4-491a-9e65-e49bc66fa41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b449ef-99c4-491a-9e65-e49bc66fa41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026e7dae-4722-4b57-8359-58b4d9c536e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:07 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume 1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f', 'volume_size': 1} Jul 03 01:26:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:08 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b641e5c-051a-4b67-8174-0d131bce6e22 1073741824" returned: 0 in 0.946s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Flow 'volume_create_manager' (f4f5a91c-baad-4edc-82d1-74c83eb47272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293015c2-623a-4d4f-87e4-1124776b06e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b641e5c-051a-4b67-8174-0d131bce6e22 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293015c2-623a-4d4f-87e4-1124776b06e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-674877802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9075141c-e94a-4e91-94f8-3666a23a9324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea8cbf5374d4e71a59d494dc5cf8ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:08Z,use_quota=True,user_id='d910714ad71b4e3dae3c0d9e01d5a0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffefa54d-87f8-4100-a68d-8a76d2d322fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b641e5c-051a-4b67-8174-0d131bce6e22 Jul 03 01:26:08 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffefa54d-87f8-4100-a68d-8a76d2d322fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83655b5b-1899-4d20-b768-b1264aae87ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83655b5b-1899-4d20-b768-b1264aae87ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9075141c-e94a-4e91-94f8-3666a23a9324', 'volume_name': 'volume-9075141c-e94a-4e91-94f8-3666a23a9324', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bea514-cb0a-4a33-a7eb-da9456b904ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bea514-cb0a-4a33-a7eb-da9456b904ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199e763f-eaf0-4757-ad6f-102864f6629e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume 9075141c-e94a-4e91-94f8-3666a23a9324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9075141c-e94a-4e91-94f8-3666a23a9324', 'volume_size': 1} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Flow 'volume_create_manager' (514ebc9e-3f07-4367-94fb-bc974b82e0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bfaaae-2635-4c45-a77a-8267e2cc3e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bfaaae-2635-4c45-a77a-8267e2cc3e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2063362376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f7a8a4-2901-4801-b647-51d7a5df69bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea8cbf5374d4e71a59d494dc5cf8ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:08Z,use_quota=True,user_id='d910714ad71b4e3dae3c0d9e01d5a0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b2657f-e7b4-4a22-8858-bfd91fe29a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b2657f-e7b4-4a22-8858-bfd91fe29a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40b9ef5-27cc-439c-9062-dc3c55f3b227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40b9ef5-27cc-439c-9062-dc3c55f3b227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f7a8a4-2901-4801-b647-51d7a5df69bc', 'volume_name': 'volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ddaf07-8778-4e29-ba04-ab706c898749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ddaf07-8778-4e29-ba04-ab706c898749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8637a8d3-d459-411a-9d33-c1e0854d98fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume a9f7a8a4-2901-4801-b647-51d7a5df69bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc', 'volume_size': 1} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:08 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b641e5c-051a-4b67-8174-0d131bce6e22" returned: 0 in 0.703s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.363s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-297164790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94310ef-d7ea-4761-9f80-16127b047759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea8cbf5374d4e71a59d494dc5cf8ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:07Z,use_quota=True,user_id='d910714ad71b4e3dae3c0d9e01d5a0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Creating volume b94310ef-d7ea-4761-9f80-16127b047759 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:08 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b94310ef-d7ea-4761-9f80-16127b047759 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05721c0a-1b04-4da8-abd7-13d8161af4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b641e5c-051a-4b67-8174-0d131bce6e22', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b94310ef-d7ea-4761-9f80-16127b047759 1073741824 Jul 03 01:26:08 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777b5a5c-876d-49d9-acfc-84ba858550a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume volume-2b641e5c-051a-4b67-8174-0d131bce6e22 (2b641e5c-051a-4b67-8174-0d131bce6e22): created successfully Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777b5a5c-876d-49d9-acfc-84ba858550a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Flow 'volume_create_manager' (a97ee894-983b-4f4e-94a3-9c11d51faeef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:08 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-62af8822-6151-4d40-98e8-9d4ae73a9ee2 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Created volume successfully. Jul 03 01:26:09 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b94310ef-d7ea-4761-9f80-16127b047759 1073741824" returned: 0 in 0.820s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b94310ef-d7ea-4761-9f80-16127b047759 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:09 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b94310ef-d7ea-4761-9f80-16127b047759 Jul 03 01:26:09 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:10 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b94310ef-d7ea-4761-9f80-16127b047759" returned: 0 in 0.641s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.493s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766806445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea8cbf5374d4e71a59d494dc5cf8ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:08Z,use_quota=True,user_id='d910714ad71b4e3dae3c0d9e01d5a0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Creating volume 1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:10 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c644199b-3eb6-41f2-ac2f-b6dd6ba02809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94310ef-d7ea-4761-9f80-16127b047759', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:10 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f 1073741824 Jul 03 01:26:10 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369c3edd-1aff-4ed3-ac02-f40c44572740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:10 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume volume-b94310ef-d7ea-4761-9f80-16127b047759 (b94310ef-d7ea-4761-9f80-16127b047759): created successfully Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369c3edd-1aff-4ed3-ac02-f40c44572740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Flow 'volume_create_manager' (977b7970-36c7-4e1a-bec7-e66811c94d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:10 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-00711ba5-7dfe-4bd2-9dcc-a9357fbcf098 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Created volume successfully. Jul 03 01:26:11 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f 1073741824" returned: 0 in 0.815s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:11 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f Jul 03 01:26:11 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:11 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f" returned: 0 in 0.616s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.614s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-674877802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9075141c-e94a-4e91-94f8-3666a23a9324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea8cbf5374d4e71a59d494dc5cf8ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:08Z,use_quota=True,user_id='d910714ad71b4e3dae3c0d9e01d5a0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Creating volume 9075141c-e94a-4e91-94f8-3666a23a9324 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:11 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9075141c-e94a-4e91-94f8-3666a23a9324 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:11 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9075141c-e94a-4e91-94f8-3666a23a9324 1073741824 Jul 03 01:26:11 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026e7dae-4722-4b57-8359-58b4d9c536e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b14b746-f7b0-4c22-8770-b2de9669750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:11 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f (1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f): created successfully Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b14b746-f7b0-4c22-8770-b2de9669750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Flow 'volume_create_manager' (9bdea8ee-558f-4c3c-a5b2-1b1002155073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:11 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=61,cinder:UPDATE=82,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:26:11 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f814a55e-d820-4f67-8041-1db2bec9fb7d tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Created volume successfully. Jul 03 01:26:12 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9075141c-e94a-4e91-94f8-3666a23a9324 1073741824" returned: 0 in 0.803s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9075141c-e94a-4e91-94f8-3666a23a9324 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:12 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9075141c-e94a-4e91-94f8-3666a23a9324 Jul 03 01:26:12 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:13 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9075141c-e94a-4e91-94f8-3666a23a9324" returned: 0 in 0.623s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.757s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2063362376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f7a8a4-2901-4801-b647-51d7a5df69bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea8cbf5374d4e71a59d494dc5cf8ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:08Z,use_quota=True,user_id='d910714ad71b4e3dae3c0d9e01d5a0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Creating volume a9f7a8a4-2901-4801-b647-51d7a5df69bc {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:13 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199e763f-eaf0-4757-ad6f-102864f6629e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9075141c-e94a-4e91-94f8-3666a23a9324', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:13 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc 1073741824 Jul 03 01:26:13 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aecb3e8-819b-4ec2-a4c9-a77e95eaa6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:13 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume volume-9075141c-e94a-4e91-94f8-3666a23a9324 (9075141c-e94a-4e91-94f8-3666a23a9324): created successfully Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aecb3e8-819b-4ec2-a4c9-a77e95eaa6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Flow 'volume_create_manager' (f4f5a91c-baad-4edc-82d1-74c83eb47272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f8ad1935-7172-4408-9ca8-9112267021c9 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Created volume successfully. Jul 03 01:26:14 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc 1073741824" returned: 0 in 0.805s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:14 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc Jul 03 01:26:14 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:14 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc" returned: 0 in 0.623s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8637a8d3-d459-411a-9d33-c1e0854d98fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6335df-a593-43cb-b4f5-0e5cba6e088a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:14 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Volume volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc (a9f7a8a4-2901-4801-b647-51d7a5df69bc): created successfully Jul 03 01:26:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6335df-a593-43cb-b4f5-0e5cba6e088a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Flow 'volume_create_manager' (514ebc9e-3f07-4367-94fb-bc974b82e0e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:14 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3cb0f0bb-6f1c-4111-a2f2-74b5e30f365a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Created volume successfully. Jul 03 01:26:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "cinder-a9f7a8a4-2901-4801-b647-51d7a5df69bc-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-a9f7a8a4-2901-4801-b647-51d7a5df69bc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "cinder-quobyte-a9f7a8a4-2901-4801-b647-51d7a5df69bc" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-quobyte-a9f7a8a4-2901-4801-b647-51d7a5df69bc" acquired by "delete_volume" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:15 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc9b328-a082-4089-a8c9-afedca59ba10]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:15 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc Jul 03 01:26:15 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:15 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc" returned: 0 in 0.729s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:15 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc Jul 03 01:26:15 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:16 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-a9f7a8a4-2901-4801-b647-51d7a5df69bc" returned: 0 in 0.616s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-quobyte-a9f7a8a4-2901-4801-b647-51d7a5df69bc" released by "delete_volume" :: held 1.386s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:16 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Created reservations ['033b5249-c13a-4e2d-b355-71a1d1293b96', 'e0b4329c-eb14-4fcd-b1f6-a545594a6d92', '64301dbf-287d-4ff8-9a9e-5a123f0aac4d', '7492399d-3ca7-429c-b7d5-4c6f9c5744ad'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:16 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:16 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:26:16 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:17 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.615s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:17 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:17 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Deleted volume successfully. Jul 03 01:26:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1b912e27-77ef-479e-8974-afe931065eb4 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-a9f7a8a4-2901-4801-b647-51d7a5df69bc-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "cinder-9075141c-e94a-4e91-94f8-3666a23a9324-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-9075141c-e94a-4e91-94f8-3666a23a9324-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "cinder-quobyte-9075141c-e94a-4e91-94f8-3666a23a9324" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-quobyte-9075141c-e94a-4e91-94f8-3666a23a9324" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:17 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d0e20a-7982-4cf5-b74f-f7afbaa9a2d8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9075141c-e94a-4e91-94f8-3666a23a9324 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:17 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9075141c-e94a-4e91-94f8-3666a23a9324 Jul 03 01:26:17 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:18 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9075141c-e94a-4e91-94f8-3666a23a9324" returned: 0 in 0.731s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9075141c-e94a-4e91-94f8-3666a23a9324 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:18 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9075141c-e94a-4e91-94f8-3666a23a9324 Jul 03 01:26:18 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:18 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9075141c-e94a-4e91-94f8-3666a23a9324" returned: 0 in 0.653s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-quobyte-9075141c-e94a-4e91-94f8-3666a23a9324" released by "delete_volume" :: held 1.420s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:18 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Created reservations ['6036d91f-3ec4-40fe-ab1b-9133b12c598a', '13466234-58dc-4ed8-99ba-4d8f5e2153c4', '6c9f12b4-2922-42fe-bbce-b94d6454877b', 'b469d1f5-17cd-4b4f-935d-03633afb5f4a'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:18 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:26:18 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "cinder-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:19 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.667s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:19 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:19 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Deleted volume successfully. Jul 03 01:26:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "cinder-quobyte-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ca48ca32-cd3e-42a9-a7af-9b644231b09e tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-9075141c-e94a-4e91-94f8-3666a23a9324-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-quobyte-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:19 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eacd763-e166-4055-8987-1aa2bdf8b329]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:19 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f Jul 03 01:26:19 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:20 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f" returned: 0 in 0.806s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:20 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f Jul 03 01:26:20 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:21 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f" returned: 0 in 0.662s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-quobyte-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f" released by "delete_volume" :: held 1.509s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Created reservations ['c1342416-1d05-4346-975d-c54d263b51fc', 'e061bf40-2f35-4b5a-a3ba-718bba7a28a9', '18e51363-a158-4625-b7eb-00f6f460f062', 'a36954bf-103e-429e-ae3d-ee751929670d'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:21 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:26:21 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "cinder-b94310ef-d7ea-4761-9f80-16127b047759-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-b94310ef-d7ea-4761-9f80-16127b047759-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "cinder-quobyte-b94310ef-d7ea-4761-9f80-16127b047759" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-quobyte-b94310ef-d7ea-4761-9f80-16127b047759" acquired by "delete_volume" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6634ff-0c2e-4f1f-91ac-7e8cd4a61e09]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b94310ef-d7ea-4761-9f80-16127b047759 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:21 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.651s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:21 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Deleted volume successfully. Jul 03 01:26:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-23980d65-5fbc-490e-9edb-3c4517a07193 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-1b4d7b73-0bb5-4cb6-a3ea-59e1ff99a22f-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:21 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b94310ef-d7ea-4761-9f80-16127b047759 Jul 03 01:26:21 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:22 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b94310ef-d7ea-4761-9f80-16127b047759" returned: 0 in 0.755s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b94310ef-d7ea-4761-9f80-16127b047759 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:22 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b94310ef-d7ea-4761-9f80-16127b047759 Jul 03 01:26:22 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:23 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b94310ef-d7ea-4761-9f80-16127b047759" returned: 0 in 0.624s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-quobyte-b94310ef-d7ea-4761-9f80-16127b047759" released by "delete_volume" :: held 1.422s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Created reservations ['bee10d13-5e3a-46d6-a3d4-a89dd13d0d1f', '609494de-eebf-4405-b04e-dda9eb28c0a9', '1d63622e-99f0-4bf0-a5ed-720812c8f6da', '13372fb5-b9e5-4950-9ddb-7e04306adb3c'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:23 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:26:23 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "cinder-2b641e5c-051a-4b67-8174-0d131bce6e22-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-2b641e5c-051a-4b67-8174-0d131bce6e22-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:23 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.620s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:23 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Deleted volume successfully. Jul 03 01:26:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "cinder-quobyte-2b641e5c-051a-4b67-8174-0d131bce6e22" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c8da76cc-f0f7-4bc3-ae55-b406277ebc2a tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-b94310ef-d7ea-4761-9f80-16127b047759-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-quobyte-2b641e5c-051a-4b67-8174-0d131bce6e22" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:24 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eba7898-eb12-45c7-a1a0-dc49c2b1df7f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b641e5c-051a-4b67-8174-0d131bce6e22 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:24 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b641e5c-051a-4b67-8174-0d131bce6e22 Jul 03 01:26:24 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:24 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b641e5c-051a-4b67-8174-0d131bce6e22" returned: 0 in 0.711s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b641e5c-051a-4b67-8174-0d131bce6e22 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:24 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b641e5c-051a-4b67-8174-0d131bce6e22 Jul 03 01:26:24 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:25 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-2b641e5c-051a-4b67-8174-0d131bce6e22" returned: 0 in 0.610s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-quobyte-2b641e5c-051a-4b67-8174-0d131bce6e22" released by "delete_volume" :: held 1.358s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:25 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Created reservations ['4dde53f7-d365-412e-aa0c-13e07eb62cea', '829b28a2-6d9b-44d3-9aec-77baee85a872', 'e4b3658c-48e0-43bc-9157-37ea5fe9c9bc', '0076fde4-0b79-4596-8e61-68708c65f687'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:25 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:26:25 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:26 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.609s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:26 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:26 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Deleted volume successfully. Jul 03 01:26:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f4f33fcc-afc9-498d-ac1b-ff5bb534124c tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-2b641e5c-051a-4b67-8174-0d131bce6e22-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "cinder-e42da1e6-80aa-4107-b8f0-ff983919b983-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-e42da1e6-80aa-4107-b8f0-ff983919b983-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "cinder-quobyte-e42da1e6-80aa-4107-b8f0-ff983919b983" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-quobyte-e42da1e6-80aa-4107-b8f0-ff983919b983" acquired by "delete_volume" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:26 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c274ea1-2747-4c44-98d6-c6551980d208]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e42da1e6-80aa-4107-b8f0-ff983919b983 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:26 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e42da1e6-80aa-4107-b8f0-ff983919b983 Jul 03 01:26:26 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:27 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e42da1e6-80aa-4107-b8f0-ff983919b983" returned: 0 in 0.738s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e42da1e6-80aa-4107-b8f0-ff983919b983 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:27 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e42da1e6-80aa-4107-b8f0-ff983919b983 Jul 03 01:26:27 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:27 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e42da1e6-80aa-4107-b8f0-ff983919b983" returned: 0 in 0.617s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-quobyte-e42da1e6-80aa-4107-b8f0-ff983919b983" released by "delete_volume" :: held 1.396s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Created reservations ['40bf0fb7-74fb-4649-9c57-15075cc9f77f', 'c70a0262-39d2-437c-8101-3c0516b74ed4', '86d0eeb2-bb0e-4df2-adc6-60a2daeecb6d', '22ca9125-1257-41dd-95c7-886a26e9e4e3'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:27 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:26:27 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:27 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:26:27 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:28 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.667s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:28 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Deleted volume successfully. Jul 03 01:26:28 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c9e84bb7-d8cb-4f04-9613-1441b2cebb07 tempest-CreateVolumesFromSourceVolumeTest-667921976 None] Lock "cinder-e42da1e6-80aa-4107-b8f0-ff983919b983-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:28 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.646s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:26:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:26:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Flow 'volume_create_manager' (3bd38832-350b-402b-9314-f73c4efbd2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776034db-719d-4256-92cb-ed62cc87ac30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776034db-719d-4256-92cb-ed62cc87ac30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a229ea-7a2f-42b0-b4fd-85ef41662fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5c0adc8ef4c70aaa84852a5eac480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:31Z,use_quota=True,user_id='0782fc6a68f244eeaba68953013e7f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4031df71-e019-41cf-a482-8110e069fc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4031df71-e019-41cf-a482-8110e069fc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a65bb33-a053-42cf-888e-3a20bf396fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a65bb33-a053-42cf-888e-3a20bf396fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a229ea-7a2f-42b0-b4fd-85ef41662fe4', 'volume_name': 'volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238b27f1-0997-4524-a203-c32cd32d4834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238b27f1-0997-4524-a203-c32cd32d4834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec27e3f5-7fc8-4df3-95b9-bac3de639fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:31 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Volume 89a229ea-7a2f-42b0-b4fd-85ef41662fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4', 'volume_size': 1} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a229ea-7a2f-42b0-b4fd-85ef41662fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5c0adc8ef4c70aaa84852a5eac480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:31Z,use_quota=True,user_id='0782fc6a68f244eeaba68953013e7f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Creating volume 89a229ea-7a2f-42b0-b4fd-85ef41662fe4 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:31 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:26:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:31 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4 1073741824 Jul 03 01:26:31 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:32 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4 1073741824" returned: 0 in 0.785s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:32 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4 Jul 03 01:26:32 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:32 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4" returned: 0 in 0.633s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec27e3f5-7fc8-4df3-95b9-bac3de639fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9386d07-fac7-489f-9a35-53deabc3f5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:32 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Volume volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4 (89a229ea-7a2f-42b0-b4fd-85ef41662fe4): created successfully Jul 03 01:26:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9386d07-fac7-489f-9a35-53deabc3f5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Flow 'volume_create_manager' (3bd38832-350b-402b-9314-f73c4efbd2cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:32 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-cf55fa84-634d-48d0-a96a-9100c946ed2f tempest-CinderUnicodeTest-1500497085 None] Created volume successfully. Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Flow 'volume_create_manager' (d503edae-856f-4778-9f96-bcd2796192dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfdc3c86-f39c-419c-8536-1b3bbd7cd209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfdc3c86-f39c-419c-8536-1b3bbd7cd209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-576721439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d147d7df-aa65-422e-be22-17c494f1dd84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5c0adc8ef4c70aaa84852a5eac480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:34Z,use_quota=True,user_id='0782fc6a68f244eeaba68953013e7f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d99392-0882-42d5-bbe3-f034c5ce2605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d99392-0882-42d5-bbe3-f034c5ce2605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64994d68-8197-4b1a-b66c-2d6e9fe6eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64994d68-8197-4b1a-b66c-2d6e9fe6eeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd147d7df-aa65-422e-be22-17c494f1dd84', 'volume_name': 'volume-d147d7df-aa65-422e-be22-17c494f1dd84', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc210704-2353-4926-8c96-f4442959b43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc210704-2353-4926-8c96-f4442959b43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e5372b-5c1c-4ace-a742-c3d5835bc873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:33 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Volume d147d7df-aa65-422e-be22-17c494f1dd84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d147d7df-aa65-422e-be22-17c494f1dd84', 'volume_size': 1} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-576721439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d147d7df-aa65-422e-be22-17c494f1dd84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee5c0adc8ef4c70aaa84852a5eac480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:34Z,use_quota=True,user_id='0782fc6a68f244eeaba68953013e7f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Creating volume d147d7df-aa65-422e-be22-17c494f1dd84 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:33 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:26:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:33 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84 1073741824 Jul 03 01:26:33 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:34 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84 1073741824" returned: 0 in 0.804s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:34 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84 Jul 03 01:26:34 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:35 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84" returned: 0 in 0.683s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e5372b-5c1c-4ace-a742-c3d5835bc873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d147d7df-aa65-422e-be22-17c494f1dd84', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb32486-4f7d-451d-b3b4-33a4e0af86bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:35 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Volume volume-d147d7df-aa65-422e-be22-17c494f1dd84 (d147d7df-aa65-422e-be22-17c494f1dd84): created successfully Jul 03 01:26:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb32486-4f7d-451d-b3b4-33a4e0af86bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:35 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Flow 'volume_create_manager' (d503edae-856f-4778-9f96-bcd2796192dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:35 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-40683966-1478-447d-ab07-7cf7250163af tempest-CinderUnicodeTest-1500497085 None] Created volume successfully. Jul 03 01:26:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] Creating offline snapshot 0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 of volume d147d7df-aa65-422e-be22-17c494f1dd84 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:26:36 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[24abbfd2-288d-466b-9fdd-10891a53aa05]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:36 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84 Jul 03 01:26:36 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:36 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84" returned: 0 in 0.788s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:36 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 1G Jul 03 01:26:36 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:37 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 1G" returned: 0 in 0.789s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d147d7df-aa65-422e-be22-17c494f1dd84 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:37 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d147d7df-aa65-422e-be22-17c494f1dd84 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 Jul 03 01:26:37 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:38 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d147d7df-aa65-422e-be22-17c494f1dd84 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767" returned: 0 in 0.680s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:38 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 is being set with open permissions: ugo+rw Jul 03 01:26:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:38 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 Jul 03 01:26:38 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:38 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767" returned: 0 in 0.611s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:38 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.info Jul 03 01:26:38 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:39 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.info" returned: 0 in 0.648s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:39 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.info is being set with open permissions: ugo+rw Jul 03 01:26:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:39 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.info Jul 03 01:26:39 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:40 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.info" returned: 0 in 0.646s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.248s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:40 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d76c2d94-322e-4403-986f-076a96c16859 tempest-CinderUnicodeTest-1500497085 None] Create snapshot completed successfully Jul 03 01:26:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "cinder-0d49f0df-a9bb-4124-a8dd-4dc24a7a2767-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-0d49f0df-a9bb-4124-a8dd-4dc24a7a2767-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "cinder-quobyte-d147d7df-aa65-422e-be22-17c494f1dd84" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-quobyte-d147d7df-aa65-422e-be22-17c494f1dd84" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "cinder-quobyte-0d49f0df-a9bb-4124-a8dd-4dc24a7a2767" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-quobyte-0d49f0df-a9bb-4124-a8dd-4dc24a7a2767" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Deleting offline snapshot 0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 of volume d147d7df-aa65-422e-be22-17c494f1dd84 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:26:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] snapshot_file for this snap is: volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:26:41 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bef84b-e737-49e7-a6a2-45df78cbeb09]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:41 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 Jul 03 01:26:41 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:42 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767" returned: 0 in 0.760s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d147d7df-aa65-422e-be22-17c494f1dd84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:26:42 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[65260797-2e52-4c86-aaba-d6a385da8f9e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:42 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84 Jul 03 01:26:42 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:42 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84" returned: 0 in 0.727s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:42 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 Jul 03 01:26:42 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:43 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767" returned: 0 in 0.730s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:43 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767 Jul 03 01:26:43 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:44 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84.0d49f0df-a9bb-4124-a8dd-4dc24a7a2767" returned: 0 in 0.651s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-quobyte-0d49f0df-a9bb-4124-a8dd-4dc24a7a2767" released by "_delete_snapshot" :: held 2.962s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-quobyte-d147d7df-aa65-422e-be22-17c494f1dd84" released by "delete_snapshot" :: held 2.986s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:44 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Created reservations ['a5fbe1ca-f1d5-4fbe-a08d-def299e95796', '981f8742-d20e-41f1-bc2e-e5b6ec92eeea', '6007903b-fa6e-4f8d-aa57-1b5b43059cba', '4863c10f-556e-4d26-816c-53025f351380'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:44 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Delete snapshot completed successfully. Jul 03 01:26:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71d82f47-85fc-4083-b913-db02e2e1dd82 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-0d49f0df-a9bb-4124-a8dd-4dc24a7a2767-delete_snapshot" released by "delete_snapshot" :: held 3.124s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "cinder-d147d7df-aa65-422e-be22-17c494f1dd84-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-d147d7df-aa65-422e-be22-17c494f1dd84-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "cinder-quobyte-d147d7df-aa65-422e-be22-17c494f1dd84" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-quobyte-d147d7df-aa65-422e-be22-17c494f1dd84" acquired by "delete_volume" :: waited 0.013s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:44 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[811c9da8-5955-4209-abf9-846faec518c5]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:44 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84 Jul 03 01:26:44 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:45 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84" returned: 0 in 0.835s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:45 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84 Jul 03 01:26:45 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:46 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d147d7df-aa65-422e-be22-17c494f1dd84" returned: 0 in 0.667s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-quobyte-d147d7df-aa65-422e-be22-17c494f1dd84" released by "delete_volume" :: held 1.562s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Created reservations ['a178fc81-264f-40aa-8c85-4a39e62e2792', '4a7cd256-eb80-409a-9ba5-5cee1d2d3d22', 'e071614a-47cb-4f57-a4cd-b855a50907bd', 'fa849837-477c-461a-a32e-fd61f9d04b37'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:46 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:26:46 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "cinder-89a229ea-7a2f-42b0-b4fd-85ef41662fe4-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-89a229ea-7a2f-42b0-b4fd-85ef41662fe4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "cinder-quobyte-89a229ea-7a2f-42b0-b4fd-85ef41662fe4" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-quobyte-89a229ea-7a2f-42b0-b4fd-85ef41662fe4" acquired by "delete_volume" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[417fdf21-ed25-487e-8708-a40d3fff7633]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:46 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.647s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:46 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Deleted volume successfully. Jul 03 01:26:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eccee8d0-852a-4533-b348-b2a2449bb764 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-d147d7df-aa65-422e-be22-17c494f1dd84-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:46 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4 Jul 03 01:26:46 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:47 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4" returned: 0 in 0.801s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:47 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4 Jul 03 01:26:47 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:48 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-89a229ea-7a2f-42b0-b4fd-85ef41662fe4" returned: 0 in 0.647s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-quobyte-89a229ea-7a2f-42b0-b4fd-85ef41662fe4" released by "delete_volume" :: held 1.486s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:48 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Created reservations ['91123719-d847-495f-a1b5-918e0d1aa446', '0a845cee-f193-4210-ae75-8b22577fd3e0', 'f9530b16-d58a-4745-9827-5857f332abeb', '2c946e70-f27b-4602-988a-8a547d570f5a'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:48 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:26:48 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:48 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.648s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:48 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:48 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Deleted volume successfully. Jul 03 01:26:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-c4464199-2538-40ba-92bf-698533bace30 tempest-CinderUnicodeTest-1500497085 None] Lock "cinder-89a229ea-7a2f-42b0-b4fd-85ef41662fe4-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:58 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=46,cinder:INSERT=22,cinder:UPDATE=82,cinder:DELETE=8 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:26:58 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=98,cinder:SELECT=73,cinder:DELETE=9,cinder:INSERT=20 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Flow 'volume_create_manager' (c6dfc4fb-9f58-4896-b69f-acbb73b92219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d64d3d9-7e5d-406d-b4fb-782bc165f078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d64d3d9-7e5d-406d-b4fb-782bc165f078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1997477825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ba9ac1-935d-4a9f-aa1f-644d94e2ac91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51a01eee3254c4b88ec2b84e8c46074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:00Z,use_quota=True,user_id='f7c5e3fba9bd4e50b4e3f1e23b5ba89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8159d4c0-00e5-4a4e-818b-a9125d461c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8159d4c0-00e5-4a4e-818b-a9125d461c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5bd2da-e883-46bd-9445-b4a3cd925f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5bd2da-e883-46bd-9445-b4a3cd925f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ba9ac1-935d-4a9f-aa1f-644d94e2ac91', 'volume_name': 'volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f125079d-3f94-4dc9-95e4-74251bf68fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f125079d-3f94-4dc9-95e4-74251bf68fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de93d00-97d6-48bf-b187-36cca24efedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:00 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume 26ba9ac1-935d-4a9f-aa1f-644d94e2ac91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91', 'volume_size': 1} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1997477825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ba9ac1-935d-4a9f-aa1f-644d94e2ac91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51a01eee3254c4b88ec2b84e8c46074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:00Z,use_quota=True,user_id='f7c5e3fba9bd4e50b4e3f1e23b5ba89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Creating volume 26ba9ac1-935d-4a9f-aa1f-644d94e2ac91 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:00 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:00 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91 1073741824 Jul 03 01:27:00 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Flow 'volume_create_manager' (c51d9cb8-5df1-428a-834b-971970662904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd8bb13-e1ca-46ae-a199-86e013e6eb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd8bb13-e1ca-46ae-a199-86e013e6eb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1417569583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61275a6e-5972-4e88-80f8-cdada8f068ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810b520c2197422aa8ba0a3414c51851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:01Z,use_quota=True,user_id='761d2e05b17f49cfb38165cc0a7f72ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9d3409-e304-4fbf-aa75-7b13ea93605b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9d3409-e304-4fbf-aa75-7b13ea93605b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f45b03-fb16-4153-8a38-7832ce634b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f45b03-fb16-4153-8a38-7832ce634b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61275a6e-5972-4e88-80f8-cdada8f068ef', 'volume_name': 'volume-61275a6e-5972-4e88-80f8-cdada8f068ef', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:00 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0155fa8-96da-42da-a8bd-e98c02259584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0155fa8-96da-42da-a8bd-e98c02259584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbb8487-16a2-40f0-91ed-a1c7fd65295e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Volume 61275a6e-5972-4e88-80f8-cdada8f068ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61275a6e-5972-4e88-80f8-cdada8f068ef', 'volume_size': 1} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Flow 'volume_create_manager' (eb03068f-2fae-4c22-92e9-0fe272c924cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9344bebc-a4d3-4655-afb1-dc02c00b903d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9344bebc-a4d3-4655-afb1-dc02c00b903d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-108885162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd5f173-ba22-41f3-9cac-5bc4b38c70da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf63ca6a204e0e93e3cccf87e7289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:01Z,use_quota=True,user_id='dc397e3055494e86b6502d66b384dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00ae1a6-ebeb-46f9-b691-cef97b4dba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00ae1a6-ebeb-46f9-b691-cef97b4dba06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a7a776-b19a-4f2b-98c2-015b6f1ee580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a7a776-b19a-4f2b-98c2-015b6f1ee580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dd5f173-ba22-41f3-9cac-5bc4b38c70da', 'volume_name': 'volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e89daf1-e26a-4c7b-95cc-865ea4e1557d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e89daf1-e26a-4c7b-95cc-865ea4e1557d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a1f248-bc06-48f5-953a-7a0549a6e928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume 5dd5f173-ba22-41f3-9cac-5bc4b38c70da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da', 'volume_size': 1} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Flow 'volume_create_manager' (e697be5d-4dd9-4d4f-a8b9-e6751a2e792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3bc507-d4e0-4441-82b3-e18348288eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3bc507-d4e0-4441-82b3-e18348288eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-628555964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680d4b56-1514-4c0e-818b-c92e1f3bad3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810b520c2197422aa8ba0a3414c51851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:01Z,use_quota=True,user_id='761d2e05b17f49cfb38165cc0a7f72ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486d1ed3-2bd3-4751-b6a7-c362a14ebbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486d1ed3-2bd3-4751-b6a7-c362a14ebbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0bc003-391d-418d-86e0-573ab69ef6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0bc003-391d-418d-86e0-573ab69ef6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680d4b56-1514-4c0e-818b-c92e1f3bad3d', 'volume_name': 'volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a5ebac-7a59-45ba-af65-a9dd438be8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a5ebac-7a59-45ba-af65-a9dd438be8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff45eaeb-eb40-4fa2-9aee-9e3e7aadc39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Volume 680d4b56-1514-4c0e-818b-c92e1f3bad3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d', 'volume_size': 1} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:01 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Flow 'volume_create_manager' (9d949abf-5e1d-467e-b1ae-61ed974ce3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3591a0-e79e-44d5-a20c-30b9fbc7fdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91 1073741824" returned: 0 in 1.238s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3591a0-e79e-44d5-a20c-30b9fbc7fdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1698955050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1858d4-3be8-4941-a925-557eb7dfb924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810b520c2197422aa8ba0a3414c51851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:01Z,use_quota=True,user_id='761d2e05b17f49cfb38165cc0a7f72ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0165edc2-451f-445d-8514-682e2bfbd670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0165edc2-451f-445d-8514-682e2bfbd670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a771bc2-e55f-4308-bc12-0f322d87ac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a771bc2-e55f-4308-bc12-0f322d87ac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc1858d4-3be8-4941-a925-557eb7dfb924', 'volume_name': 'volume-fc1858d4-3be8-4941-a925-557eb7dfb924', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bac299-e287-4cb7-ace9-9617b01173bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bac299-e287-4cb7-ace9-9617b01173bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6baeb231-fcb7-4dfa-bb8c-9138d394b3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:01 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Volume fc1858d4-3be8-4941-a925-557eb7dfb924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc1858d4-3be8-4941-a925-557eb7dfb924', 'volume_size': 1} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:01 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91 Jul 03 01:27:01 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:01 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Flow 'volume_create_manager' (be998eba-7727-490d-a628-bdb2219e6cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdf3708-d112-40a5-bfa4-bf865e6f046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdf3708-d112-40a5-bfa4-bf865e6f046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1206927612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4125e3e9-ad0c-4601-bde7-82bb381f2231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810b520c2197422aa8ba0a3414c51851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:02Z,use_quota=True,user_id='761d2e05b17f49cfb38165cc0a7f72ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da092f85-82a4-4d3b-93c5-6298ae21c3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da092f85-82a4-4d3b-93c5-6298ae21c3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb0a6f2-cc14-4fe5-9026-77878dec43f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb0a6f2-cc14-4fe5-9026-77878dec43f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4125e3e9-ad0c-4601-bde7-82bb381f2231', 'volume_name': 'volume-4125e3e9-ad0c-4601-bde7-82bb381f2231', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332c6376-cdab-4f13-ac88-fd9308b0a5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332c6376-cdab-4f13-ac88-fd9308b0a5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e796390b-5e35-4af0-bb52-791efde7cdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:02 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Volume 4125e3e9-ad0c-4601-bde7-82bb381f2231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4125e3e9-ad0c-4601-bde7-82bb381f2231', 'volume_size': 1} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:02 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Flow 'volume_create_manager' (2d346737-bb22-48c5-911d-bd7817bd93e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac257ced-c2b8-41e0-bee5-b871b968995d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91" returned: 0 in 0.756s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.399s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1417569583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61275a6e-5972-4e88-80f8-cdada8f068ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810b520c2197422aa8ba0a3414c51851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:01Z,use_quota=True,user_id='761d2e05b17f49cfb38165cc0a7f72ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Creating volume 61275a6e-5972-4e88-80f8-cdada8f068ef {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:02 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-61275a6e-5972-4e88-80f8-cdada8f068ef 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac257ced-c2b8-41e0-bee5-b871b968995d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2119522593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ffcfd2-d874-475c-b051-28863a0c553a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810b520c2197422aa8ba0a3414c51851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:02Z,use_quota=True,user_id='761d2e05b17f49cfb38165cc0a7f72ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:02 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-61275a6e-5972-4e88-80f8-cdada8f068ef 1073741824 Jul 03 01:27:02 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80993e0a-737d-4b91-b59d-2170594628a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80993e0a-737d-4b91-b59d-2170594628a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45b8f50-ee8b-4183-9c07-960dce434a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45b8f50-ee8b-4183-9c07-960dce434a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ffcfd2-d874-475c-b051-28863a0c553a', 'volume_name': 'volume-d5ffcfd2-d874-475c-b051-28863a0c553a', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348f1828-7343-4c09-b360-6826038ef4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348f1828-7343-4c09-b360-6826038ef4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2854287-a138-4395-afbb-004cb6d5b1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:02 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Volume d5ffcfd2-d874-475c-b051-28863a0c553a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ffcfd2-d874-475c-b051-28863a0c553a', 'volume_size': 1} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de93d00-97d6-48bf-b187-36cca24efedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb4e090-880b-45b0-a636-6c9ba4a2b0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:02 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91 (26ba9ac1-935d-4a9f-aa1f-644d94e2ac91): created successfully Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb4e090-880b-45b0-a636-6c9ba4a2b0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:02 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Flow 'volume_create_manager' (c6dfc4fb-9f58-4896-b69f-acbb73b92219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:02 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-0b11ca3d-4981-42fd-bd4f-1a2168718602 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Created volume successfully. Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Flow 'volume_create_manager' (a1e25b25-a3c3-41ba-bec1-be6296b9f02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8baddfb0-9174-4e18-9c32-5cb2b93ecc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8baddfb0-9174-4e18-9c32-5cb2b93ecc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-938308447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74c313d-65cc-4301-9f93-5e77b2bc4f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51a01eee3254c4b88ec2b84e8c46074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:03Z,use_quota=True,user_id='f7c5e3fba9bd4e50b4e3f1e23b5ba89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93f509f-ccdf-4128-8d15-c19e27927123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93f509f-ccdf-4128-8d15-c19e27927123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8911b818-654f-48c9-88b5-a43f4b00a957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8911b818-654f-48c9-88b5-a43f4b00a957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e74c313d-65cc-4301-9f93-5e77b2bc4f1c', 'volume_name': 'volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef332299-413a-41e9-ba21-234ac33fa086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef332299-413a-41e9-ba21-234ac33fa086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5156cc-51c5-4e1b-a573-b8ec6a61f3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:03 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume e74c313d-65cc-4301-9f93-5e77b2bc4f1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c', 'volume_size': 1} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:03 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-61275a6e-5972-4e88-80f8-cdada8f068ef 1073741824" returned: 0 in 1.140s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-61275a6e-5972-4e88-80f8-cdada8f068ef {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:03 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-61275a6e-5972-4e88-80f8-cdada8f068ef Jul 03 01:27:03 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Flow 'volume_create_manager' (725617b2-bb63-4813-a284-a440badeb67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5a5dc7-55e8-4c5c-8b05-4a411ef2b204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5a5dc7-55e8-4c5c-8b05-4a411ef2b204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-821316343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa08146-5afc-41bf-b01a-21fadcb15e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51a01eee3254c4b88ec2b84e8c46074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:04Z,use_quota=True,user_id='f7c5e3fba9bd4e50b4e3f1e23b5ba89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe02e33-1cf1-445f-811f-eb43f7ca6eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe02e33-1cf1-445f-811f-eb43f7ca6eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc74478a-4890-4ed9-85ae-a16fefa738af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc74478a-4890-4ed9-85ae-a16fefa738af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fa08146-5afc-41bf-b01a-21fadcb15e70', 'volume_name': 'volume-5fa08146-5afc-41bf-b01a-21fadcb15e70', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65698c99-dd18-493e-a3b3-f72e76767d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65698c99-dd18-493e-a3b3-f72e76767d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f29d16e-7e95-4198-a8bf-07e86b299f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:03 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume 5fa08146-5afc-41bf-b01a-21fadcb15e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fa08146-5afc-41bf-b01a-21fadcb15e70', 'volume_size': 1} Jul 03 01:27:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Flow 'volume_create_manager' (8bfe213b-fd3a-4ce3-a671-434ba46f2e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3d6a37-7f42-4a31-a2e9-0c34ee3e43b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3d6a37-7f42-4a31-a2e9-0c34ee3e43b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1770667567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a2e5a3-6ed4-4e95-8566-b6245bd31f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51a01eee3254c4b88ec2b84e8c46074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:04Z,use_quota=True,user_id='f7c5e3fba9bd4e50b4e3f1e23b5ba89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3402f92a-7435-4fdb-99d8-78d317f90b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3402f92a-7435-4fdb-99d8-78d317f90b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d40e6e-f015-4987-a596-daefe5de2351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d40e6e-f015-4987-a596-daefe5de2351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a2e5a3-6ed4-4e95-8566-b6245bd31f0f', 'volume_name': 'volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1470102-62b6-48ae-9650-8f4242f6b97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1470102-62b6-48ae-9650-8f4242f6b97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2269399c-22c6-4119-bea0-4f00ec5d24d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume 78a2e5a3-6ed4-4e95-8566-b6245bd31f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f', 'volume_size': 1} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:04 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-61275a6e-5972-4e88-80f8-cdada8f068ef" returned: 0 in 0.905s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] <== create_volume: return (2109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.364s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-108885162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd5f173-ba22-41f3-9cac-5bc4b38c70da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf63ca6a204e0e93e3cccf87e7289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:01Z,use_quota=True,user_id='dc397e3055494e86b6502d66b384dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Creating volume 5dd5f173-ba22-41f3-9cac-5bc4b38c70da {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:04 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbb8487-16a2-40f0-91ed-a1c7fd65295e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61275a6e-5972-4e88-80f8-cdada8f068ef', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51452495-b2f4-4198-9e2d-d37c94fb6f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da 1073741824 Jul 03 01:27:04 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:04 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Volume volume-61275a6e-5972-4e88-80f8-cdada8f068ef (61275a6e-5972-4e88-80f8-cdada8f068ef): created successfully Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51452495-b2f4-4198-9e2d-d37c94fb6f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Flow 'volume_create_manager' (c51d9cb8-5df1-428a-834b-971970662904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:04 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8fc73b35-00e9-4fee-9dfe-8836142122c3 tempest-CreateVolumesFromImageTest-50098392 None] Created volume successfully. Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Flow 'volume_create_manager' (6006ffba-6614-4183-a4b0-3a812b08d642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfac5abd-f1de-4cce-a3fe-91c4fd3664a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfac5abd-f1de-4cce-a3fe-91c4fd3664a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-126458817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164c2a39-c0f5-4917-a1cc-e11269402a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51a01eee3254c4b88ec2b84e8c46074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:05Z,use_quota=True,user_id='f7c5e3fba9bd4e50b4e3f1e23b5ba89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62099af9-04c4-450c-ac6e-c9427caace65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62099af9-04c4-450c-ac6e-c9427caace65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31133cc4-9f86-4315-9159-ec72ceb6c6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31133cc4-9f86-4315-9159-ec72ceb6c6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164c2a39-c0f5-4917-a1cc-e11269402a4e', 'volume_name': 'volume-164c2a39-c0f5-4917-a1cc-e11269402a4e', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd4adb6-660a-400f-a1fd-f2c53b9f6115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd4adb6-660a-400f-a1fd-f2c53b9f6115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87502e47-cb7e-4055-8a79-1abf7a4485f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume 164c2a39-c0f5-4917-a1cc-e11269402a4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164c2a39-c0f5-4917-a1cc-e11269402a4e', 'volume_size': 1} Jul 03 01:27:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Flow 'volume_create_manager' (1ccd0fec-193d-4ec1-b4c6-2313810b8d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614b9077-0362-4f18-a2d8-a7bec9f7aecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614b9077-0362-4f18-a2d8-a7bec9f7aecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734ea576-4b4b-4e46-b729-189048dbc2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243398fd002244b9a228bd22b16f862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:05Z,use_quota=True,user_id='49b9d075f308434c9b31b5a6e17180eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9a7f348-b9da-448b-8b9f-637ff2b8e4dc),volume_type_id=c9a7f348-b9da-448b-8b9f-637ff2b8e4dc)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea08b2c-bc52-4ca1-9839-a8f932ab82d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea08b2c-bc52-4ca1-9839-a8f932ab82d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5def83c2-ab2b-4f8b-8e36-84ad600e131a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.image.glance [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Creating Keystone auth plugin from conf {{(pid=86357) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Flow 'volume_create_manager' (f21327f4-a079-4d84-8cbb-00a88bd06787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356f4d09-ac4b-4010-933f-1f993e3f2c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356f4d09-ac4b-4010-933f-1f993e3f2c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1236942417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f76e828-6658-4e43-8a14-5f7d29f6a856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51a01eee3254c4b88ec2b84e8c46074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:05Z,use_quota=True,user_id='f7c5e3fba9bd4e50b4e3f1e23b5ba89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3a5013-2716-4123-873d-c782d8a938ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3a5013-2716-4123-873d-c782d8a938ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1030d15c-697d-4411-9663-dabf4c7740ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1030d15c-697d-4411-9663-dabf4c7740ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f76e828-6658-4e43-8a14-5f7d29f6a856', 'volume_name': 'volume-5f76e828-6658-4e43-8a14-5f7d29f6a856', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3a2442-adcf-4162-affe-28ce152ced18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3a2442-adcf-4162-affe-28ce152ced18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4eb0a7f-2d64-48e5-b2de-138b0c8bb15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:05 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume 5f76e828-6658-4e43-8a14-5f7d29f6a856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f76e828-6658-4e43-8a14-5f7d29f6a856', 'volume_size': 1} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5def83c2-ab2b-4f8b-8e36-84ad600e131a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '734ea576-4b4b-4e46-b729-189048dbc2ea', 'volume_name': 'volume-734ea576-4b4b-4e46-b729-189048dbc2ea', 'volume_size': 1, 'image_id': 'f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '484bd1e645c32955bd177caeed879e24', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '243398fd002244b9a228bd22b16f862e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ebff41a3ac172d2e3a580d6c0258cf83868adbafe54bd2c92832d128915e97451deeaf9ea88daa761abe5f1d14c16f4f94e5109f2a60f57b1d2b54f91139006', 'id': 'f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6', 'created_at': datetime.datetime(2026, 7, 2, 23, 27, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 27, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e683887-2039-4a4c-b258-ed699922f6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e683887-2039-4a4c-b258-ed699922f6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a63217f-9dd8-42cb-b42f-afd1deba4bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:05 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Volume 734ea576-4b4b-4e46-b729-189048dbc2ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-734ea576-4b4b-4e46-b729-189048dbc2ea', 'volume_size': 1, 'image_id': 'f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '484bd1e645c32955bd177caeed879e24', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '243398fd002244b9a228bd22b16f862e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ebff41a3ac172d2e3a580d6c0258cf83868adbafe54bd2c92832d128915e97451deeaf9ea88daa761abe5f1d14c16f4f94e5109f2a60f57b1d2b54f91139006', 'id': 'f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6', 'created_at': datetime.datetime(2026, 7, 2, 23, 27, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 27, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Trying to clone 734ea576-4b4b-4e46-b729-189048dbc2ea from image f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6', 'metadata': {}}]). {{(pid=86357) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:27:05 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Image download 0.00 MB at 0.00 MB/s Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1c24c8-fc6f-48c0-ba24-adebd9aca4b7]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:05 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da 1073741824" returned: 0 in 1.002s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:05 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD Jul 03 01:27:05 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:05 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da Jul 03 01:27:05 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:06 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD" returned: 0 in 0.731s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:06 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da" returned: 0 in 0.665s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.899s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-628555964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680d4b56-1514-4c0e-818b-c92e1f3bad3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810b520c2197422aa8ba0a3414c51851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:01Z,use_quota=True,user_id='761d2e05b17f49cfb38165cc0a7f72ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Creating volume 680d4b56-1514-4c0e-818b-c92e1f3bad3d {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:06 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a1f248-bc06-48f5-953a-7a0549a6e928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:06 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d 1073741824 Jul 03 01:27:06 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8278ef01-8684-422f-9f5f-66f23690263a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:06 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da (5dd5f173-ba22-41f3-9cac-5bc4b38c70da): created successfully Jul 03 01:27:06 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD Jul 03 01:27:06 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8278ef01-8684-422f-9f5f-66f23690263a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Flow 'volume_create_manager' (eb03068f-2fae-4c22-92e9-0fe272c924cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:06 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-69c0853e-64fb-4f13-89f9-5f66aedafdea tempest-CreateVolumesFromSnapshotTest-1639480290 None] Created volume successfully. Jul 03 01:27:06 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD" returned: 1 in 0.711s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Temporary image f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6 is fetched for user 49b9d075f308434c9b31b5a6e17180eb. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85bf03f-74bd-4315-9f84-920f1e539887]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:07 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:07 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD Jul 03 01:27:07 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d 1073741824" returned: 0 in 0.853s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:07 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d Jul 03 01:27:07 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:07 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD" returned: 0 in 0.765s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:07 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d" returned: 0 in 0.660s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.201s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1698955050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1858d4-3be8-4941-a925-557eb7dfb924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810b520c2197422aa8ba0a3414c51851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:01Z,use_quota=True,user_id='761d2e05b17f49cfb38165cc0a7f72ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Creating volume fc1858d4-3be8-4941-a925-557eb7dfb924 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:07 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fc1858d4-3be8-4941-a925-557eb7dfb924 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:07 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD Jul 03 01:27:07 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff45eaeb-eb40-4fa2-9aee-9e3e7aadc39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9ed99a-3abf-4b7f-8051-919c00a8d559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:07 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fc1858d4-3be8-4941-a925-557eb7dfb924 1073741824 Jul 03 01:27:07 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:07 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Volume volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d (680d4b56-1514-4c0e-818b-c92e1f3bad3d): created successfully Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9ed99a-3abf-4b7f-8051-919c00a8d559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:07 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Flow 'volume_create_manager' (e697be5d-4dd9-4d4f-a8b9-e6751a2e792b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:07 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-eeff8353-671a-4e32-98d5-b648d016569d tempest-CreateVolumesFromImageTest-50098392 None] Created volume successfully. Jul 03 01:27:08 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD" returned: 1 in 0.738s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:27:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:08 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fc1858d4-3be8-4941-a925-557eb7dfb924 1073741824" returned: 0 in 0.865s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fc1858d4-3be8-4941-a925-557eb7dfb924 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:08 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fc1858d4-3be8-4941-a925-557eb7dfb924 Jul 03 01:27:08 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:09 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fc1858d4-3be8-4941-a925-557eb7dfb924" returned: 0 in 0.693s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.376s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1206927612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4125e3e9-ad0c-4601-bde7-82bb381f2231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810b520c2197422aa8ba0a3414c51851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:02Z,use_quota=True,user_id='761d2e05b17f49cfb38165cc0a7f72ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Creating volume 4125e3e9-ad0c-4601-bde7-82bb381f2231 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:09 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4125e3e9-ad0c-4601-bde7-82bb381f2231 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6baeb231-fcb7-4dfa-bb8c-9138d394b3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc1858d4-3be8-4941-a925-557eb7dfb924', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f162c7ed-57d2-428b-8e55-df155470d5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:09 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4125e3e9-ad0c-4601-bde7-82bb381f2231 1073741824 Jul 03 01:27:09 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:09 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Volume volume-fc1858d4-3be8-4941-a925-557eb7dfb924 (fc1858d4-3be8-4941-a925-557eb7dfb924): created successfully Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f162c7ed-57d2-428b-8e55-df155470d5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:09 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Flow 'volume_create_manager' (9d949abf-5e1d-467e-b1ae-61ed974ce3f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:09 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c52cd919-f719-4020-8dd0-f5fafcc03834 tempest-CreateVolumesFromImageTest-50098392 None] Created volume successfully. Jul 03 01:27:10 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4125e3e9-ad0c-4601-bde7-82bb381f2231 1073741824" returned: 0 in 0.867s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4125e3e9-ad0c-4601-bde7-82bb381f2231 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:10 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4125e3e9-ad0c-4601-bde7-82bb381f2231 Jul 03 01:27:10 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:10 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4125e3e9-ad0c-4601-bde7-82bb381f2231" returned: 0 in 0.629s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.489s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2119522593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ffcfd2-d874-475c-b051-28863a0c553a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810b520c2197422aa8ba0a3414c51851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:02Z,use_quota=True,user_id='761d2e05b17f49cfb38165cc0a7f72ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Creating volume d5ffcfd2-d874-475c-b051-28863a0c553a {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:10 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d5ffcfd2-d874-475c-b051-28863a0c553a 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:11 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d5ffcfd2-d874-475c-b051-28863a0c553a 1073741824 Jul 03 01:27:11 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e796390b-5e35-4af0-bb52-791efde7cdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4125e3e9-ad0c-4601-bde7-82bb381f2231', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85302132-7cdc-4321-ac61-f403aede7efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:11 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Volume volume-4125e3e9-ad0c-4601-bde7-82bb381f2231 (4125e3e9-ad0c-4601-bde7-82bb381f2231): created successfully Jul 03 01:27:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85302132-7cdc-4321-ac61-f403aede7efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:11 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Flow 'volume_create_manager' (be998eba-7727-490d-a628-bdb2219e6cb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:11 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-20e85dd9-e900-40d4-99c8-2eecde74de8a tempest-CreateVolumesFromImageTest-50098392 None] Created volume successfully. Jul 03 01:27:11 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d5ffcfd2-d874-475c-b051-28863a0c553a 1073741824" returned: 0 in 0.877s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d5ffcfd2-d874-475c-b051-28863a0c553a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:11 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d5ffcfd2-d874-475c-b051-28863a0c553a Jul 03 01:27:11 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:12 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d5ffcfd2-d874-475c-b051-28863a0c553a" returned: 0 in 0.667s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.225s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-938308447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74c313d-65cc-4301-9f93-5e77b2bc4f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51a01eee3254c4b88ec2b84e8c46074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:03Z,use_quota=True,user_id='f7c5e3fba9bd4e50b4e3f1e23b5ba89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Creating volume e74c313d-65cc-4301-9f93-5e77b2bc4f1c {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:12 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:12 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c 1073741824 Jul 03 01:27:12 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2854287-a138-4395-afbb-004cb6d5b1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ffcfd2-d874-475c-b051-28863a0c553a', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d5f48b-998a-44df-be9b-58230372b526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:12 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Volume volume-d5ffcfd2-d874-475c-b051-28863a0c553a (d5ffcfd2-d874-475c-b051-28863a0c553a): created successfully Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d5f48b-998a-44df-be9b-58230372b526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Flow 'volume_create_manager' (2d346737-bb22-48c5-911d-bd7817bd93e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:12 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d82d57e5-eca0-44d6-b280-ae354e8d6f50 tempest-CreateVolumesFromImageTest-50098392 None] Created volume successfully. Jul 03 01:27:13 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c 1073741824" returned: 0 in 0.827s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:13 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c Jul 03 01:27:13 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "cinder-d5ffcfd2-d874-475c-b051-28863a0c553a-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-d5ffcfd2-d874-475c-b051-28863a0c553a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "cinder-quobyte-d5ffcfd2-d874-475c-b051-28863a0c553a" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-quobyte-d5ffcfd2-d874-475c-b051-28863a0c553a" acquired by "delete_volume" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:13 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[476f6a24-4aa9-449a-981a-ae0057deef6e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d5ffcfd2-d874-475c-b051-28863a0c553a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:13 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d5ffcfd2-d874-475c-b051-28863a0c553a Jul 03 01:27:13 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:14 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c" returned: 0 in 0.719s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.356s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-821316343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa08146-5afc-41bf-b01a-21fadcb15e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51a01eee3254c4b88ec2b84e8c46074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:04Z,use_quota=True,user_id='f7c5e3fba9bd4e50b4e3f1e23b5ba89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Creating volume 5fa08146-5afc-41bf-b01a-21fadcb15e70 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:14 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5fa08146-5afc-41bf-b01a-21fadcb15e70 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5156cc-51c5-4e1b-a573-b8ec6a61f3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:14 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5fa08146-5afc-41bf-b01a-21fadcb15e70 1073741824 Jul 03 01:27:14 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4e753f-46da-488d-8b24-5f91532b379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:14 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c (e74c313d-65cc-4301-9f93-5e77b2bc4f1c): created successfully Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4e753f-46da-488d-8b24-5f91532b379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Flow 'volume_create_manager' (a1e25b25-a3c3-41ba-bec1-be6296b9f02d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:14 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-588135bb-5522-4dfe-aa21-c431ba3e2712 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Created volume successfully. Jul 03 01:27:14 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d5ffcfd2-d874-475c-b051-28863a0c553a" returned: 0 in 0.839s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d5ffcfd2-d874-475c-b051-28863a0c553a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:14 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d5ffcfd2-d874-475c-b051-28863a0c553a Jul 03 01:27:14 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:15 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5fa08146-5afc-41bf-b01a-21fadcb15e70 1073741824" returned: 0 in 0.864s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5fa08146-5afc-41bf-b01a-21fadcb15e70 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:15 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-d5ffcfd2-d874-475c-b051-28863a0c553a" returned: 0 in 0.673s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:15 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5fa08146-5afc-41bf-b01a-21fadcb15e70 Jul 03 01:27:15 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-quobyte-d5ffcfd2-d874-475c-b051-28863a0c553a" released by "delete_volume" :: held 1.565s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Created reservations ['0d313fef-0667-497e-8f08-790fb14466be', '113d200a-09c8-43e8-82b5-d91b5cedf407', '20820a13-d101-4f3f-98d6-dc41ee70ba0f', 'f7fbe52d-72bb-46da-bcfd-d732bfcfb9de'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:15 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:15 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "cinder-4125e3e9-ad0c-4601-bde7-82bb381f2231-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:15 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5fa08146-5afc-41bf-b01a-21fadcb15e70" returned: 0 in 0.664s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.471s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1770667567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a2e5a3-6ed4-4e95-8566-b6245bd31f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51a01eee3254c4b88ec2b84e8c46074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:04Z,use_quota=True,user_id='f7c5e3fba9bd4e50b4e3f1e23b5ba89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Creating volume 78a2e5a3-6ed4-4e95-8566-b6245bd31f0f {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:15 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-4125e3e9-ad0c-4601-bde7-82bb381f2231-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:15 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f 1073741824 Jul 03 01:27:15 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f29d16e-7e95-4198-a8bf-07e86b299f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa08146-5afc-41bf-b01a-21fadcb15e70', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84632f3-039c-49fb-a65a-e3d93ed36680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:15 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume volume-5fa08146-5afc-41bf-b01a-21fadcb15e70 (5fa08146-5afc-41bf-b01a-21fadcb15e70): created successfully Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84632f3-039c-49fb-a65a-e3d93ed36680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Flow 'volume_create_manager' (725617b2-bb63-4813-a284-a440badeb67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "cinder-quobyte-4125e3e9-ad0c-4601-bde7-82bb381f2231" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:15 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-bf46a7d3-0890-4a92-9529-9db337fe962b tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Created volume successfully. Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-quobyte-4125e3e9-ad0c-4601-bde7-82bb381f2231" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[542f21d0-5cc7-42dd-ba89-084a7303ec8d]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4125e3e9-ad0c-4601-bde7-82bb381f2231 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:15 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.700s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:15 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Deleted volume successfully. Jul 03 01:27:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d96a1d10-9cfb-49c3-a796-cb5f5564bd34 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-d5ffcfd2-d874-475c-b051-28863a0c553a-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:16 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4125e3e9-ad0c-4601-bde7-82bb381f2231 Jul 03 01:27:16 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:16 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f 1073741824" returned: 0 in 0.853s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:16 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4125e3e9-ad0c-4601-bde7-82bb381f2231" returned: 0 in 0.786s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4125e3e9-ad0c-4601-bde7-82bb381f2231 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:16 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f Jul 03 01:27:16 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:16 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4125e3e9-ad0c-4601-bde7-82bb381f2231 Jul 03 01:27:16 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:17 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f" returned: 0 in 0.638s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.351s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-126458817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164c2a39-c0f5-4917-a1cc-e11269402a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51a01eee3254c4b88ec2b84e8c46074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:05Z,use_quota=True,user_id='f7c5e3fba9bd4e50b4e3f1e23b5ba89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Creating volume 164c2a39-c0f5-4917-a1cc-e11269402a4e {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:17 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-164c2a39-c0f5-4917-a1cc-e11269402a4e 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2269399c-22c6-4119-bea0-4f00ec5d24d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:17 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e8902b-67ec-4838-8f0d-dce01779d548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:17 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-164c2a39-c0f5-4917-a1cc-e11269402a4e 1073741824 Jul 03 01:27:17 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4125e3e9-ad0c-4601-bde7-82bb381f2231" returned: 0 in 0.669s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-quobyte-4125e3e9-ad0c-4601-bde7-82bb381f2231" released by "delete_volume" :: held 1.501s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:17 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f (78a2e5a3-6ed4-4e95-8566-b6245bd31f0f): created successfully Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e8902b-67ec-4838-8f0d-dce01779d548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Flow 'volume_create_manager' (8bfe213b-fd3a-4ce3-a671-434ba46f2e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:17 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c5b0e3ba-99b7-4509-9adc-03abd72eae11 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Created volume successfully. Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Created reservations ['ccdad4d6-3486-4573-9f6f-b4ba461578d9', '5010b94d-cc62-4d06-bc8b-b86e81abbf6e', '02f6653e-b5e9-4cc8-8866-4529ecf492a9', '327791a7-450b-47d4-8f95-be0e60ce0895'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:17 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:17 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "cinder-fc1858d4-3be8-4941-a925-557eb7dfb924-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-fc1858d4-3be8-4941-a925-557eb7dfb924-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "cinder-quobyte-fc1858d4-3be8-4941-a925-557eb7dfb924" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-quobyte-fc1858d4-3be8-4941-a925-557eb7dfb924" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd9cc03-56e6-499a-85d1-a944af55b886]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fc1858d4-3be8-4941-a925-557eb7dfb924 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:18 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.666s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:18 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Deleted volume successfully. Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f58cc704-386b-4ffb-93b6-032f963b7e26 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-4125e3e9-ad0c-4601-bde7-82bb381f2231-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:18 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fc1858d4-3be8-4941-a925-557eb7dfb924 Jul 03 01:27:18 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:18 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-164c2a39-c0f5-4917-a1cc-e11269402a4e 1073741824" returned: 0 in 0.936s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-164c2a39-c0f5-4917-a1cc-e11269402a4e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:18 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-164c2a39-c0f5-4917-a1cc-e11269402a4e Jul 03 01:27:18 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:18 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fc1858d4-3be8-4941-a925-557eb7dfb924" returned: 0 in 0.802s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fc1858d4-3be8-4941-a925-557eb7dfb924 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:18 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fc1858d4-3be8-4941-a925-557eb7dfb924 Jul 03 01:27:18 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:18 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-164c2a39-c0f5-4917-a1cc-e11269402a4e" returned: 0 in 0.693s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.781s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1236942417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f76e828-6658-4e43-8a14-5f7d29f6a856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51a01eee3254c4b88ec2b84e8c46074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:05Z,use_quota=True,user_id='f7c5e3fba9bd4e50b4e3f1e23b5ba89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Creating volume 5f76e828-6658-4e43-8a14-5f7d29f6a856 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:19 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5f76e828-6658-4e43-8a14-5f7d29f6a856 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:19 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5f76e828-6658-4e43-8a14-5f7d29f6a856 1073741824 Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87502e47-cb7e-4055-8a79-1abf7a4485f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164c2a39-c0f5-4917-a1cc-e11269402a4e', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:19 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23df3c0-649a-44a7-bf72-3efd9c91c64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:19 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume volume-164c2a39-c0f5-4917-a1cc-e11269402a4e (164c2a39-c0f5-4917-a1cc-e11269402a4e): created successfully Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23df3c0-649a-44a7-bf72-3efd9c91c64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Flow 'volume_create_manager' (6006ffba-6614-4183-a4b0-3a812b08d642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:19 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ab5784a9-49c3-46fc-a81a-38c9b9e64535 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Created volume successfully. Jul 03 01:27:19 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fc1858d4-3be8-4941-a925-557eb7dfb924" returned: 0 in 0.659s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-quobyte-fc1858d4-3be8-4941-a925-557eb7dfb924" released by "delete_volume" :: held 1.506s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Created reservations ['2a7408df-c14f-4130-9be1-6ef0570fdc7c', 'ae986f65-2632-4b5e-a5ac-184baae181d3', '0ad987e5-6e44-4c44-b3ef-cae5156612cc', 'fc136ad8-c318-4ccf-8a9a-a0944d6364ba'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:19 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:19 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:19 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5f76e828-6658-4e43-8a14-5f7d29f6a856 1073741824" returned: 0 in 0.915s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5f76e828-6658-4e43-8a14-5f7d29f6a856 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:19 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5f76e828-6658-4e43-8a14-5f7d29f6a856 Jul 03 01:27:20 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "cinder-680d4b56-1514-4c0e-818b-c92e1f3bad3d-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-680d4b56-1514-4c0e-818b-c92e1f3bad3d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "cinder-quobyte-680d4b56-1514-4c0e-818b-c92e1f3bad3d" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-quobyte-680d4b56-1514-4c0e-818b-c92e1f3bad3d" acquired by "delete_volume" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9df553c-3503-4ae7-8ba1-c97020587e30]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:20 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.667s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:20 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Deleted volume successfully. Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-012cc652-82f5-4eac-b003-b6deac62924c tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-fc1858d4-3be8-4941-a925-557eb7dfb924-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:20 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d Jul 03 01:27:20 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:20 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5f76e828-6658-4e43-8a14-5f7d29f6a856" returned: 0 in 0.692s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.271s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4eb0a7f-2d64-48e5-b2de-138b0c8bb15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f76e828-6658-4e43-8a14-5f7d29f6a856', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbbf66d-effc-4ec1-87cf-1b09c784c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Creating offline snapshot c9f85886-3b59-4a48-a9d4-ce7285ce143f of volume 5dd5f173-ba22-41f3-9cac-5bc4b38c70da {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:27:20 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Volume volume-5f76e828-6658-4e43-8a14-5f7d29f6a856 (5f76e828-6658-4e43-8a14-5f7d29f6a856): created successfully Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbbf66d-effc-4ec1-87cf-1b09c784c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Flow 'volume_create_manager' (f21327f4-a079-4d84-8cbb-00a88bd06787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a108d216-9e88-4c8c-be5a-88ccc7725311]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:20 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1f622cda-5c52-4a7d-9cb7-1a15357f4a40 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Created volume successfully. Jul 03 01:27:20 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da Jul 03 01:27:20 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:21 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d" returned: 0 in 0.783s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:21 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d Jul 03 01:27:21 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "cinder-5f76e828-6658-4e43-8a14-5f7d29f6a856-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-5f76e828-6658-4e43-8a14-5f7d29f6a856-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "cinder-quobyte-5f76e828-6658-4e43-8a14-5f7d29f6a856" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-quobyte-5f76e828-6658-4e43-8a14-5f7d29f6a856" acquired by "delete_volume" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:21 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e35afd7-c8d4-4b12-a4ba-de600b3ca5df]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5f76e828-6658-4e43-8a14-5f7d29f6a856 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:21 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5f76e828-6658-4e43-8a14-5f7d29f6a856 Jul 03 01:27:21 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:21 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da" returned: 0 in 0.787s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:21 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f 1G Jul 03 01:27:21 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:21 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-680d4b56-1514-4c0e-818b-c92e1f3bad3d" returned: 0 in 0.806s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-quobyte-680d4b56-1514-4c0e-818b-c92e1f3bad3d" released by "delete_volume" :: held 1.631s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Created reservations ['e9ecae85-fb6a-4d56-9c6d-e8df4cd498a5', 'b3234be0-139f-40f3-a539-d896fc83fa0a', '18d8cf4a-043e-4e95-bf02-5edbc13c21d5', '6801c838-298d-4095-98e3-39951e5b4db6'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:22 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5f76e828-6658-4e43-8a14-5f7d29f6a856" returned: 0 in 0.808s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5f76e828-6658-4e43-8a14-5f7d29f6a856 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:22 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:22 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:22 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5f76e828-6658-4e43-8a14-5f7d29f6a856 Jul 03 01:27:22 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:22 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f 1G" returned: 0 in 0.863s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:22 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f Jul 03 01:27:22 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "cinder-61275a6e-5972-4e88-80f8-cdada8f068ef-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-61275a6e-5972-4e88-80f8-cdada8f068ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "cinder-quobyte-61275a6e-5972-4e88-80f8-cdada8f068ef" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-quobyte-61275a6e-5972-4e88-80f8-cdada8f068ef" acquired by "delete_volume" :: waited 0.032s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b76c07-60a7-404e-8517-23b5b131d461]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-61275a6e-5972-4e88-80f8-cdada8f068ef {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:22 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-61275a6e-5972-4e88-80f8-cdada8f068ef Jul 03 01:27:22 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:22 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.801s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:22 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Deleted volume successfully. Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-94c33666-3e02-49eb-9acc-abb0e6e58ec4 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-680d4b56-1514-4c0e-818b-c92e1f3bad3d-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:22 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5f76e828-6658-4e43-8a14-5f7d29f6a856" returned: 0 in 0.836s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-quobyte-5f76e828-6658-4e43-8a14-5f7d29f6a856" released by "delete_volume" :: held 1.692s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Created reservations ['7668a8b6-fdc8-430f-9fc5-7a43b30f9e65', '1015edb6-6278-4e49-9f8b-0cee59b03a42', '28d83b17-7ac4-4683-86dc-1669b1191fdd', '44dc4e47-60ed-4aab-aabc-685ff28cac83'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:23 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:23 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:23 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f" returned: 0 in 0.835s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:23 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f is being set with open permissions: ugo+rw Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:23 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f Jul 03 01:27:23 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "cinder-164c2a39-c0f5-4917-a1cc-e11269402a4e-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-164c2a39-c0f5-4917-a1cc-e11269402a4e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:23 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-61275a6e-5972-4e88-80f8-cdada8f068ef" returned: 0 in 0.903s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-61275a6e-5972-4e88-80f8-cdada8f068ef {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "cinder-quobyte-164c2a39-c0f5-4917-a1cc-e11269402a4e" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:23 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-61275a6e-5972-4e88-80f8-cdada8f068ef Jul 03 01:27:23 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-quobyte-164c2a39-c0f5-4917-a1cc-e11269402a4e" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7b8d5a-124a-4fbf-9858-a426c4336a2f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-164c2a39-c0f5-4917-a1cc-e11269402a4e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:23 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-164c2a39-c0f5-4917-a1cc-e11269402a4e Jul 03 01:27:23 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:23 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.735s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:23 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Deleted volume successfully. Jul 03 01:27:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-03130faf-9949-4e34-a379-40bf1d100f9d tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-5f76e828-6658-4e43-8a14-5f7d29f6a856-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:24 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f" returned: 0 in 0.801s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:24 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.info Jul 03 01:27:24 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:24 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-61275a6e-5972-4e88-80f8-cdada8f068ef" returned: 0 in 0.730s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-quobyte-61275a6e-5972-4e88-80f8-cdada8f068ef" released by "delete_volume" :: held 1.673s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Created reservations ['ea201bae-a01d-4a61-80ac-65db2bddfece', '2cf5daf3-eef7-412e-a7d1-d2fb933b3ae4', 'd047fe1c-8ad2-481a-9bc2-6b76bb234f12', 'b0c57d92-cd59-4952-91a2-cfa19a0e5181'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:24 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:24 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:24 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-164c2a39-c0f5-4917-a1cc-e11269402a4e" returned: 0 in 0.879s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-164c2a39-c0f5-4917-a1cc-e11269402a4e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:24 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-164c2a39-c0f5-4917-a1cc-e11269402a4e Jul 03 01:27:24 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:24 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.info" returned: 0 in 0.677s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:24 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.info is being set with open permissions: ugo+rw Jul 03 01:27:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:24 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.info Jul 03 01:27:24 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:25 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.795s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Deleted volume successfully. Jul 03 01:27:25 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-164c2a39-c0f5-4917-a1cc-e11269402a4e" returned: 0 in 0.727s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-quobyte-164c2a39-c0f5-4917-a1cc-e11269402a4e" released by "delete_volume" :: held 1.662s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-bdefb62b-d85c-4535-b160-7b644d59e4b3 tempest-CreateVolumesFromImageTest-50098392 None] Lock "cinder-61275a6e-5972-4e88-80f8-cdada8f068ef-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Created reservations ['4fa3aa58-bdaf-4c48-b85d-bbbac3a93838', 'f063bfb8-7694-46b2-9073-fa2b57c80872', 'e914d53f-2110-45ac-80f8-7a81a7606e40', 'ac548565-b2ab-4ca6-add9-139b1aa80078'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:25 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:25 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:25 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.info" returned: 0 in 0.804s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.904s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.078s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734ea576-4b4b-4e46-b729-189048dbc2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243398fd002244b9a228bd22b16f862e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:05Z,use_quota=True,user_id='49b9d075f308434c9b31b5a6e17180eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9a7f348-b9da-448b-8b9f-637ff2b8e4dc),volume_type_id=c9a7f348-b9da-448b-8b9f-637ff2b8e4dc)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Creating volume 734ea576-4b4b-4e46-b729-189048dbc2ea {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:25 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:25 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea 1073741824 Jul 03 01:27:25 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ae16dbe0-553a-41a5-a1f7-e28cb2ef806e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Create snapshot completed successfully Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "cinder-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "cinder-quobyte-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-quobyte-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f" acquired by "delete_volume" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa0ddc2-77be-443b-b61b-448f8e855152]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:26 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f Jul 03 01:27:26 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:26 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.944s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:26 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:26 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Deleted volume successfully. Jul 03 01:27:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-26e4d467-6637-4640-8612-c0a26ed82685 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-164c2a39-c0f5-4917-a1cc-e11269402a4e-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:26 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea 1073741824" returned: 0 in 1.150s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:26 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea Jul 03 01:27:26 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:26 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Flow 'volume_create_manager' (115ea8a0-a546-4197-9ed1-3b808fdb3823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8b661e-4671-4013-a58b-1947755d4a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8b661e-4671-4013-a58b-1947755d4a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-58281491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fd424a-7f4a-4421-8611-8a9907540d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf63ca6a204e0e93e3cccf87e7289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:27Z,use_quota=True,user_id='dc397e3055494e86b6502d66b384dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b3850b-2aef-4e6a-8563-829c27fe1383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b3850b-2aef-4e6a-8563-829c27fe1383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4a640c-bba3-41e9-b722-8a749e70557d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4a640c-bba3-41e9-b722-8a749e70557d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13fd424a-7f4a-4421-8611-8a9907540d51', 'volume_name': 'volume-13fd424a-7f4a-4421-8611-8a9907540d51', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2746c5-797e-48fd-92b9-9a0d45b5c8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2746c5-797e-48fd-92b9-9a0d45b5c8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8deec0-c2de-471a-82f6-67fb821e6d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:27 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume 13fd424a-7f4a-4421-8611-8a9907540d51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13fd424a-7f4a-4421-8611-8a9907540d51', 'volume_size': 1} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:27 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f" returned: 0 in 1.155s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:27 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f Jul 03 01:27:27 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Flow 'volume_create_manager' (aae448a6-697d-4550-8dbf-66a2208121dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cf1014-4497-446c-ab71-71822cb2da41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cf1014-4497-446c-ab71-71822cb2da41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1876220475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2ec974-0e04-4ba5-9e42-aca6efb6e892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf63ca6a204e0e93e3cccf87e7289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:27Z,use_quota=True,user_id='dc397e3055494e86b6502d66b384dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6611d6ef-18fa-4d6a-a543-e75d3a9bced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6611d6ef-18fa-4d6a-a543-e75d3a9bced0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120e9059-2955-4f6c-8f70-d89a2a9c8f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120e9059-2955-4f6c-8f70-d89a2a9c8f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2ec974-0e04-4ba5-9e42-aca6efb6e892', 'volume_name': 'volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab57fb5c-fd5e-42cf-b99e-4a8765712492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab57fb5c-fd5e-42cf-b99e-4a8765712492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6058473a-1ebc-4acb-a0ea-6235157f96e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:27 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume 9d2ec974-0e04-4ba5-9e42-aca6efb6e892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892', 'volume_size': 1} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea" returned: 0 in 1.036s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:27 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.248s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.770s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-58281491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fd424a-7f4a-4421-8611-8a9907540d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf63ca6a204e0e93e3cccf87e7289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:27Z,use_quota=True,user_id='dc397e3055494e86b6502d66b384dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Creating volume 13fd424a-7f4a-4421-8611-8a9907540d51 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:27 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-13fd424a-7f4a-4421-8611-8a9907540d51 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:27 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-13fd424a-7f4a-4421-8611-8a9907540d51 1073741824 Jul 03 01:27:27 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:27 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:27 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Flow 'volume_create_manager' (8b5a2db6-9d69-4946-833d-a4ef8f7ecd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69501396-8689-40ab-9119-d61dcb7ac716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Attempting download of f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6', 'metadata': {}}])) to volume 734ea576-4b4b-4e46-b729-189048dbc2ea. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69501396-8689-40ab-9119-d61dcb7ac716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1248023377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8faa55-c23e-4bd2-b29d-43deea35ae4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf63ca6a204e0e93e3cccf87e7289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:28Z,use_quota=True,user_id='dc397e3055494e86b6502d66b384dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5808fd-7503-4fee-bd7d-a056326976a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:28 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5808fd-7503-4fee-bd7d-a056326976a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840329a1-b62b-4bd7-ac75-8ba4fc1b26c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840329a1-b62b-4bd7-ac75-8ba4fc1b26c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac8faa55-c23e-4bd2-b29d-43deea35ae4f', 'volume_name': 'volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d388912-9db9-4235-8db0-035c58c1e5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d388912-9db9-4235-8db0-035c58c1e5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d610221-4f3d-458d-a80f-e8070d002458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:28 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume ac8faa55-c23e-4bd2-b29d-43deea35ae4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f', 'volume_size': 1} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f" returned: 0 in 1.140s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-quobyte-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f" released by "delete_volume" :: held 2.361s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9db8bdb-75b4-4f47-b888-a594960cc91e]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_m3mul0po {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:28 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_m3mul0po Jul 03 01:27:28 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Created reservations ['7946a158-6125-48c6-8b96-e9af7642f4a3', 'c2cbf599-fa8e-4f54-914b-5e5197562826', '494dd79e-4b2e-4903-8e61-a8d907d429b0', '5a03650d-3e48-4395-8b69-5b76d77df2f8'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:28 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:28 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Flow 'volume_create_manager' (493e5bdf-2a79-4883-ab67-56942796db17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0084dbbb-a267-47d4-92cd-fc7897f49ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0084dbbb-a267-47d4-92cd-fc7897f49ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2016852090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf63ca6a204e0e93e3cccf87e7289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:29Z,use_quota=True,user_id='dc397e3055494e86b6502d66b384dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1607503f-8f3e-4b71-b81c-a5659dd4ecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1607503f-8f3e-4b71-b81c-a5659dd4ecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4781b5e6-d4b2-454e-9b56-a945713af8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4781b5e6-d4b2-454e-9b56-a945713af8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab', 'volume_name': 'volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6daaab66-0e94-4671-82f9-7f2f7cc10870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6daaab66-0e94-4671-82f9-7f2f7cc10870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b04a51-e22e-484d-8cd4-c771ade9701a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume 8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab', 'volume_size': 1} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:29 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.306s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Flow 'volume_create_manager' (68f8fe3c-b695-4f6a-b641-89bff5bd1ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbbc81d-a09a-4666-8447-2ee255efb26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "cinder-5fa08146-5afc-41bf-b01a-21fadcb15e70-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbbc81d-a09a-4666-8447-2ee255efb26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1091293968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782ec7a8-a67e-4f9c-8c78-9afc2c72d11c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf63ca6a204e0e93e3cccf87e7289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:29Z,use_quota=True,user_id='dc397e3055494e86b6502d66b384dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b876d9-a82a-45fc-9b61-4a7d5e07e98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b876d9-a82a-45fc-9b61-4a7d5e07e98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:29 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0642be9f-b207-4933-ac88-ff5ba2af079a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0642be9f-b207-4933-ac88-ff5ba2af079a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782ec7a8-a67e-4f9c-8c78-9afc2c72d11c', 'volume_name': 'volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b229816-1dc3-4b2d-86cc-45517a730d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b229816-1dc3-4b2d-86cc-45517a730d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d0c34e-be26-4c3d-9017-bec54ac93aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume 782ec7a8-a67e-4f9c-8c78-9afc2c72d11c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c', 'volume_size': 1} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-5fa08146-5afc-41bf-b01a-21fadcb15e70-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_m3mul0po" returned: 0 in 1.296s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_m3mul0po {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:29 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-13fd424a-7f4a-4421-8611-8a9907540d51 1073741824" returned: 0 in 1.739s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "cinder-quobyte-5fa08146-5afc-41bf-b01a-21fadcb15e70" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-quobyte-5fa08146-5afc-41bf-b01a-21fadcb15e70" acquired by "delete_volume" :: waited 0.030s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-13fd424a-7f4a-4421-8611-8a9907540d51 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[208fde28-c0f5-4dc9-9a17-3b8caa21e4f3]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5fa08146-5afc-41bf-b01a-21fadcb15e70 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:29 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-13fd424a-7f4a-4421-8611-8a9907540d51 Jul 03 01:27:29 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:29 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.111s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:29 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_m3mul0po Jul 03 01:27:29 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Deleted volume successfully. Jul 03 01:27:29 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:29 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-66efe2a8-c6aa-4875-96b6-1e766a016874 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-78a2e5a3-6ed4-4e95-8566-b6245bd31f0f-delete_volume" released by "delete_volume" :: held 3.967s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:29 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5fa08146-5afc-41bf-b01a-21fadcb15e70 Jul 03 01:27:29 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:30 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-13fd424a-7f4a-4421-8611-8a9907540d51" returned: 0 in 0.733s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] <== create_volume: return (2552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.560s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.781s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1876220475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2ec974-0e04-4ba5-9e42-aca6efb6e892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf63ca6a204e0e93e3cccf87e7289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:27Z,use_quota=True,user_id='dc397e3055494e86b6502d66b384dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Creating volume 9d2ec974-0e04-4ba5-9e42-aca6efb6e892 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:30 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8deec0-c2de-471a-82f6-67fb821e6d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fd424a-7f4a-4421-8611-8a9907540d51', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:30 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892 1073741824 Jul 03 01:27:30 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2b659d-aa88-4d15-9f2c-f96aa9e35107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:30 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume volume-13fd424a-7f4a-4421-8611-8a9907540d51 (13fd424a-7f4a-4421-8611-8a9907540d51): created successfully Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2b659d-aa88-4d15-9f2c-f96aa9e35107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Flow 'volume_create_manager' (115ea8a0-a546-4197-9ed1-3b808fdb3823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-40686940-a8eb-44d2-bc50-69c1bb56ba2c tempest-ProjectAdminTests-641888964 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545623779297, 'free_capacity_gb': 1775.7545623779297, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86357) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 01:27:30 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-fe174744-c72d-438f-a9d6-311378f6f8b0 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Created volume successfully. Jul 03 01:27:30 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_m3mul0po" returned: 1 in 0.987s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_m3mul0po' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd232cd-c6e0-4274-8a5a-10b700692f9d]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:30 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5fa08146-5afc-41bf-b01a-21fadcb15e70" returned: 0 in 0.954s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5fa08146-5afc-41bf-b01a-21fadcb15e70 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:30 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5fa08146-5afc-41bf-b01a-21fadcb15e70 Jul 03 01:27:30 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD Jul 03 01:27:30 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:30 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:31 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892 1073741824" returned: 0 in 0.898s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:31 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:31 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892 Jul 03 01:27:31 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:31 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5fa08146-5afc-41bf-b01a-21fadcb15e70" returned: 0 in 0.811s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-quobyte-5fa08146-5afc-41bf-b01a-21fadcb15e70" released by "delete_volume" :: held 1.830s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Created reservations ['8121b60f-397e-44bb-b892-86b945f3487f', '4deaed29-b732-4a0c-b9ba-3e33db0b8c34', '7ee6db29-46cd-460c-8400-cd37fc566933', 'ccd902e6-cd9a-47a8-af4e-75924f6b2bc3'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:31 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD Jul 03 01:27:31 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:31 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:31 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "cinder-e74c313d-65cc-4301-9f93-5e77b2bc4f1c-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-e74c313d-65cc-4301-9f93-5e77b2bc4f1c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "cinder-quobyte-e74c313d-65cc-4301-9f93-5e77b2bc4f1c" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-quobyte-e74c313d-65cc-4301-9f93-5e77b2bc4f1c" acquired by "delete_volume" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f7fcfe-a19a-4ad2-81c1-bab2dc6ddc62]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:32 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c Jul 03 01:27:32 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:32 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD" returned: 1 in 0.939s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6 was raw, converting to raw {{(pid=86357) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:32 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea Jul 03 01:27:32 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:32 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892" returned: 0 in 1.153s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.323s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1248023377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8faa55-c23e-4bd2-b29d-43deea35ae4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf63ca6a204e0e93e3cccf87e7289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:28Z,use_quota=True,user_id='dc397e3055494e86b6502d66b384dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Creating volume ac8faa55-c23e-4bd2-b29d-43deea35ae4f {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:32 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:32 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6058473a-1ebc-4acb-a0ea-6235157f96e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:32 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f 1073741824 Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29181abc-992a-48a4-af5a-1fdfc5453f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:32 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.986s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:32 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892 (9d2ec974-0e04-4ba5-9e42-aca6efb6e892): created successfully Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29181abc-992a-48a4-af5a-1fdfc5453f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Flow 'volume_create_manager' (aae448a6-697d-4550-8dbf-66a2208121dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:32 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Deleted volume successfully. Jul 03 01:27:32 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a8bb03f8-5e4c-4ce1-ab9d-3a40e9b10c1a tempest-CreateVolumesFromSnapshotTest-1639480290 None] Created volume successfully. Jul 03 01:27:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dc38c522-c95e-4a76-a4a5-c7c8ff76aae9 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-5fa08146-5afc-41bf-b01a-21fadcb15e70-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:33 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c" returned: 0 in 1.353s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:33 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c Jul 03 01:27:33 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:33 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea" returned: 0 in 1.257s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:33 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6_p4qpg4bldevstack@QuobyteHD, size 0.00 MB, duration 1.26 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:27:33 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 01:27:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:33 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea 1G Jul 03 01:27:33 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:33 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f 1073741824" returned: 0 in 1.195s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:33 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f Jul 03 01:27:33 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:34 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e74c313d-65cc-4301-9f93-5e77b2bc4f1c" returned: 0 in 0.792s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-quobyte-e74c313d-65cc-4301-9f93-5e77b2bc4f1c" released by "delete_volume" :: held 2.219s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Created reservations ['85a8e973-f4bb-42d2-9f25-50a2380e492e', '2f60594b-564c-4104-8bcf-1f342fa711a7', 'f8bda8b5-f585-4fd3-9e56-1ce4aefcd863', 'cba96640-f31b-469d-ad49-e98d1fb27032'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:34 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:34 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:34 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea 1G" returned: 0 in 0.845s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[483104fc-16b3-4d4a-b3bb-98c413839340]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:34 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f" returned: 0 in 0.739s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.473s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2016852090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf63ca6a204e0e93e3cccf87e7289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:29Z,use_quota=True,user_id='dc397e3055494e86b6502d66b384dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Creating volume 8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:34 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:34 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab 1073741824 Jul 03 01:27:34 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d610221-4f3d-458d-a80f-e8070d002458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa51107-b52b-4c79-8614-14226e267e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:34 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f (ac8faa55-c23e-4bd2-b29d-43deea35ae4f): created successfully Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa51107-b52b-4c79-8614-14226e267e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Flow 'volume_create_manager' (8b5a2db6-9d69-4946-833d-a4ef8f7ecd63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:34 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ad2befde-7582-45ba-a18d-1292f14b136e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Created volume successfully. Jul 03 01:27:34 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea Jul 03 01:27:34 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:35 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.026s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:35 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:35 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Deleted volume successfully. Jul 03 01:27:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "cinder-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8db242e8-0180-462f-8f46-fa4f79d8d973 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-e74c313d-65cc-4301-9f93-5e77b2bc4f1c-delete_volume" released by "delete_volume" :: held 3.582s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "cinder-quobyte-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-quobyte-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:35 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17c0948-e38a-4a69-a4ca-03c62c5b5a49]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:35 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea" returned: 0 in 1.056s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:35 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91 Jul 03 01:27:35 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:35 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab 1073741824" returned: 0 in 1.127s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:35 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea Jul 03 01:27:35 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:35 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab Jul 03 01:27:35 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (9e30305d-3b13-43af-bac4-527b4a5ff1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e97555-4378-4fc0-9b5a-c40fd870b2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e97555-4378-4fc0-9b5a-c40fd870b2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-543225264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74519881-463b-4bb5-b928-1852718eb22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:36Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c4ead4-36b8-4db1-921e-0640db0cfdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c4ead4-36b8-4db1-921e-0640db0cfdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc788556-3e4a-42da-b5e1-d50bdd63ce2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc788556-3e4a-42da-b5e1-d50bdd63ce2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74519881-463b-4bb5-b928-1852718eb22b', 'volume_name': 'volume-74519881-463b-4bb5-b928-1852718eb22b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516bfbef-13b1-40c8-9263-30e953bee2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516bfbef-13b1-40c8-9263-30e953bee2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f086a7f-7cb7-4dbb-943a-71930904df88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:36 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Volume 74519881-463b-4bb5-b928-1852718eb22b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74519881-463b-4bb5-b928-1852718eb22b', 'volume_size': 1} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:36 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea" returned: 1 in 0.955s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Downloaded image f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6', 'metadata': {}}])) to volume 734ea576-4b4b-4e46-b729-189048dbc2ea successfully. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:27:36 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Temporary image f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6 for user 49b9d075f308434c9b31b5a6e17180eb is deleted. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Marking volume 734ea576-4b4b-4e46-b729-189048dbc2ea as bootable. {{(pid=86357) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91" returned: 0 in 0.989s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:36 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab" returned: 0 in 0.827s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1091293968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782ec7a8-a67e-4f9c-8c78-9afc2c72d11c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cf63ca6a204e0e93e3cccf87e7289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:29Z,use_quota=True,user_id='dc397e3055494e86b6502d66b384dd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Creating volume 782ec7a8-a67e-4f9c-8c78-9afc2c72d11c {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:36 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91 Jul 03 01:27:36 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:36 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Copying metadata from image f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6 to 734ea576-4b4b-4e46-b729-189048dbc2ea. {{(pid=86357) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Creating volume glance metadata for volume 734ea576-4b4b-4e46-b729-189048dbc2ea backed by image f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '484bd1e645c32955bd177caeed879e24', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86357) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:27:36 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c 1073741824 Jul 03 01:27:36 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b04a51-e22e-484d-8cd4-c771ade9701a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19a3a43-0878-406a-9ffd-6c4f5174127e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:36 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab (8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab): created successfully Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19a3a43-0878-406a-9ffd-6c4f5174127e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Flow 'volume_create_manager' (493e5bdf-2a79-4883-ab67-56942796db17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:36 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a5ef5440-fdff-4bea-84c4-24ce6697658f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Created volume successfully. Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a63217f-9dd8-42cb-b42f-afd1deba4bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-734ea576-4b4b-4e46-b729-189048dbc2ea', 'volume_size': 1, 'image_id': 'f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '484bd1e645c32955bd177caeed879e24', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '243398fd002244b9a228bd22b16f862e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ebff41a3ac172d2e3a580d6c0258cf83868adbafe54bd2c92832d128915e97451deeaf9ea88daa761abe5f1d14c16f4f94e5109f2a60f57b1d2b54f91139006', 'id': 'f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6', 'created_at': datetime.datetime(2026, 7, 2, 23, 27, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 27, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2c91c6c-7be6-470d-b8e6-16b15f8ce0f6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31617fe1-780b-4b6a-9714-c2ee69e892e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:36 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Volume volume-734ea576-4b4b-4e46-b729-189048dbc2ea (734ea576-4b4b-4e46-b729-189048dbc2ea): created successfully Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31617fe1-780b-4b6a-9714-c2ee69e892e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:36 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Flow 'volume_create_manager' (1ccd0fec-193d-4ec1-b4c6-2313810b8d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:36 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b823af1c-e722-4088-bc13-f164b3c31155 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Created volume successfully. Jul 03 01:27:37 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91" returned: 0 in 0.728s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-quobyte-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91" released by "delete_volume" :: held 1.761s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Created reservations ['94146214-ad6d-4acb-87ad-f90c00993f40', 'ed8c2966-6481-4f33-820b-205641fb71f4', '61f9fec6-d964-4f2f-a2d3-886bc59f79b3', 'cf49f49f-f8d6-4288-915c-7dcfb8d43d23'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Acquiring lock "cinder-734ea576-4b4b-4e46-b729-189048dbc2ea-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Lock "cinder-734ea576-4b4b-4e46-b729-189048dbc2ea-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:37 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c 1073741824" returned: 0 in 0.889s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:37 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:37 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Acquiring lock "cinder-quobyte-734ea576-4b4b-4e46-b729-189048dbc2ea" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Lock "cinder-quobyte-734ea576-4b4b-4e46-b729-189048dbc2ea" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:37 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c Jul 03 01:27:37 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d90fcb8-57f5-4d2e-a9e4-943ab2ee8966]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:37 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea Jul 03 01:27:37 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:38 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.784s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:38 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Deleted volume successfully. Jul 03 01:27:38 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-63f70249-a147-4d7a-bd10-b848b494c168 tempest-CreateVolumesFromSourceVolumeTest-222390555 None] Lock "cinder-26ba9ac1-935d-4a9f-aa1f-644d94e2ac91-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c" returned: 0 in 0.732s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.970s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-543225264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74519881-463b-4bb5-b928-1852718eb22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:36Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Creating volume 74519881-463b-4bb5-b928-1852718eb22b {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:38 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:38 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b 1073741824 Jul 03 01:27:38 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d0c34e-be26-4c3d-9017-bec54ac93aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b3130f2-4cf9-46bd-99a5-2a29d9d4ef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:38 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Volume volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c (782ec7a8-a67e-4f9c-8c78-9afc2c72d11c): created successfully Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b3130f2-4cf9-46bd-99a5-2a29d9d4ef0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Flow 'volume_create_manager' (68f8fe3c-b695-4f6a-b641-89bff5bd1ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:38 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-45a986de-f635-4b7d-8ee4-d3fc5802129f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Created volume successfully. Jul 03 01:27:38 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea" returned: 0 in 0.938s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:38 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea Jul 03 01:27:38 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:39 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b 1073741824" returned: 0 in 1.012s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:39 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b Jul 03 01:27:39 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:39 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea" returned: 1 in 0.905s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:27:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:39 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea Jul 03 01:27:39 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-quobyte-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:39 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73de0df-0a99-4ece-a397-9982b5b33408]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:39 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c Jul 03 01:27:39 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:40 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b" returned: 0 in 0.807s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f086a7f-7cb7-4dbb-943a-71930904df88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74519881-463b-4bb5-b928-1852718eb22b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd60792-f42c-49db-aebb-66440753b89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:40 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Volume volume-74519881-463b-4bb5-b928-1852718eb22b (74519881-463b-4bb5-b928-1852718eb22b): created successfully Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd60792-f42c-49db-aebb-66440753b89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (9e30305d-3b13-43af-bac4-527b4a5ff1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:40 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-91c052f6-f111-41da-8559-2092ed1d8b54 tempest-ProjectMemberTests-696766750 None] Created volume successfully. Jul 03 01:27:40 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-734ea576-4b4b-4e46-b729-189048dbc2ea" returned: 0 in 0.843s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Lock "cinder-quobyte-734ea576-4b4b-4e46-b729-189048dbc2ea" released by "delete_volume" :: held 2.764s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Created reservations ['55aaf1a6-0f0a-4e45-a4e6-90818f42d4d7', '2af06acb-4a28-4330-be8c-a7d0bd1b34c0', 'cd653e67-6da6-40ac-9a6c-c0f36caef7e7', '45de80c6-c85b-4ecf-a164-851ddde135c4'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:40 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c" returned: 0 in 0.928s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:40 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:40 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:40 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c Jul 03 01:27:40 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] Creating offline snapshot 1f97da86-c4bf-4a4c-bc88-83500cbe24ea of volume 74519881-463b-4bb5-b928-1852718eb22b {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[92325495-0eb0-4786-9c50-a7f992015a82]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:41 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b Jul 03 01:27:41 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:41 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.859s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:41 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Deleted volume successfully. Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5509b1bd-c65a-418a-bd99-a914f70cc227 tempest-VolumeAndVolumeTypeFromImageTest-530937041 None] Lock "cinder-734ea576-4b4b-4e46-b729-189048dbc2ea-delete_volume" released by "delete_volume" :: held 3.931s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:41 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c" returned: 0 in 0.943s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c" released by "delete_volume" :: held 1.935s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Flow 'volume_create_manager' (7636f2ec-4874-44e6-9f5f-53ae905fd502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe5826e-181b-40ad-b42b-6d774bbe7208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe5826e-181b-40ad-b42b-6d774bbe7208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2008225644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6b2d59-6eb0-4451-998d-e423c826e700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842643b5637047b29ee922c8f6cc68e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:41Z,use_quota=True,user_id='2dffe4709b934f66b457ff9f2b30a2a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f15734-7d3a-42b2-acc3-2ec073bb4928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f15734-7d3a-42b2-acc3-2ec073bb4928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f06c32c-a959-4888-ab1d-64b55598a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f06c32c-a959-4888-ab1d-64b55598a193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e6b2d59-6eb0-4451-998d-e423c826e700', 'volume_name': 'volume-6e6b2d59-6eb0-4451-998d-e423c826e700', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc0fc49-51e6-4566-83e0-6d0b292dbe53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc0fc49-51e6-4566-83e0-6d0b292dbe53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83a7e15-8f8b-4ce0-bda6-1fe0fb73fd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:41 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Volume 6e6b2d59-6eb0-4451-998d-e423c826e700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e6b2d59-6eb0-4451-998d-e423c826e700', 'volume_size': 1} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Created reservations ['456fb842-12ac-4466-8204-442b442bebbd', '36303a67-a571-4974-9b49-c6fce7722d09', 'e239b4c8-60bc-47d8-9494-b2035a6f4596', '9fce1ee8-0ea1-4df4-91c0-6468a7b41f4b'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:41 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:41 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:41 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b" returned: 0 in 0.920s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:42 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea 1G Jul 03 01:27:42 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-quobyte-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:42 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad989ab6-44d8-4b5c-a9c3-7b06121cddd2]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:42 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab Jul 03 01:27:42 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:42 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.792s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:42 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:42 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Deleted volume successfully. Jul 03 01:27:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8327eded-f543-4a56-bbf0-be00309ba112 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-782ec7a8-a67e-4f9c-8c78-9afc2c72d11c-delete_volume" released by "delete_volume" :: held 3.071s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:42 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea 1G" returned: 0 in 0.977s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74519881-463b-4bb5-b928-1852718eb22b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:42 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74519881-463b-4bb5-b928-1852718eb22b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea Jul 03 01:27:42 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:43 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab" returned: 0 in 0.942s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:43 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab Jul 03 01:27:43 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:43 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74519881-463b-4bb5-b928-1852718eb22b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea" returned: 0 in 0.831s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:43 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea is being set with open permissions: ugo+rw Jul 03 01:27:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:43 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea Jul 03 01:27:43 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:43 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab" returned: 0 in 0.768s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab" released by "delete_volume" :: held 1.788s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Created reservations ['f7b0bb89-de02-4df0-8389-30d80b7f9362', 'b945e6d9-b0c5-435f-a1ac-45684704bb3f', 'e55503c9-951f-416c-8a0f-df8d76b2fa94', '5793519d-2fda-4359-b020-4e33634e0492'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:44 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:44 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-ac8faa55-c23e-4bd2-b29d-43deea35ae4f-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-ac8faa55-c23e-4bd2-b29d-43deea35ae4f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-quobyte-ac8faa55-c23e-4bd2-b29d-43deea35ae4f" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-ac8faa55-c23e-4bd2-b29d-43deea35ae4f" acquired by "delete_volume" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[56947942-fa30-456c-b788-07157aa7d33b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:44 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea" returned: 0 in 0.819s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:44 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.info Jul 03 01:27:44 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:44 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f Jul 03 01:27:44 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:45 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.825s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:45 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:45 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Deleted volume successfully. Jul 03 01:27:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-ab428ff2-89e5-4200-8708-f03e2aa8822e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-8b6f3a34-b8ef-4b9f-bde9-6243ec7980ab-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:45 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f" returned: 0 in 0.861s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:45 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.info" returned: 0 in 0.807s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:45 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.info is being set with open permissions: ugo+rw Jul 03 01:27:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:45 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f Jul 03 01:27:45 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:45 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.info Jul 03 01:27:45 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:46 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.info" returned: 0 in 0.715s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.206s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:46 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.626s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2008225644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6b2d59-6eb0-4451-998d-e423c826e700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842643b5637047b29ee922c8f6cc68e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:41Z,use_quota=True,user_id='2dffe4709b934f66b457ff9f2b30a2a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Creating volume 6e6b2d59-6eb0-4451-998d-e423c826e700 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:46 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ac8faa55-c23e-4bd2-b29d-43deea35ae4f" returned: 0 in 0.790s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:46 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 1073741824 Jul 03 01:27:46 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-ac8faa55-c23e-4bd2-b29d-43deea35ae4f" released by "delete_volume" :: held 1.722s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:46 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-09f1d31b-e6b0-45fd-af9a-d30439ed1920 tempest-ProjectMemberTests-696766750 None] Create snapshot completed successfully Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Created reservations ['8f542c67-05c7-4505-aa3f-8f5449258e91', 'da8a12c9-b06a-4fe4-a35e-7b85af8f7ece', '7c92a38b-b15d-4c23-a7e9-0571571a4b93', '0a63453c-eb21-45ba-a9e1-85f78ed08d06'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:46 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:46 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-9d2ec974-0e04-4ba5-9e42-aca6efb6e892-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-9d2ec974-0e04-4ba5-9e42-aca6efb6e892-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-quobyte-9d2ec974-0e04-4ba5-9e42-aca6efb6e892" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-9d2ec974-0e04-4ba5-9e42-aca6efb6e892" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8d2141-85a1-42ab-89a0-e19209519d0b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:47 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892 Jul 03 01:27:47 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:47 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 1073741824" returned: 0 in 0.981s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:47 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.818s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:47 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Deleted volume successfully. Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-02d6fb9b-3fc6-4b2a-a6b3-d3050651d56f tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-ac8faa55-c23e-4bd2-b29d-43deea35ae4f-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:47 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 Jul 03 01:27:47 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-1f97da86-c4bf-4a4c-bc88-83500cbe24ea-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Lock "cinder-1f97da86-c4bf-4a4c-bc88-83500cbe24ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-74519881-463b-4bb5-b928-1852718eb22b" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-74519881-463b-4bb5-b928-1852718eb22b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-1f97da86-c4bf-4a4c-bc88-83500cbe24ea" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-1f97da86-c4bf-4a4c-bc88-83500cbe24ea" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Deleting offline snapshot 1f97da86-c4bf-4a4c-bc88-83500cbe24ea of volume 74519881-463b-4bb5-b928-1852718eb22b {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] snapshot_file for this snap is: volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f415ec5-b2b7-405c-aaf7-823438323a3e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:47 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea Jul 03 01:27:47 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:47 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892" returned: 0 in 0.950s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:47 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892 Jul 03 01:27:47 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:48 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700" returned: 0 in 0.835s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83a7e15-8f8b-4ce0-bda6-1fe0fb73fd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6b2d59-6eb0-4451-998d-e423c826e700', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c2010c-75d4-4cbb-b6b9-e08a0a64ed17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:48 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Volume volume-6e6b2d59-6eb0-4451-998d-e423c826e700 (6e6b2d59-6eb0-4451-998d-e423c826e700): created successfully Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c2010c-75d4-4cbb-b6b9-e08a0a64ed17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Flow 'volume_create_manager' (7636f2ec-4874-44e6-9f5f-53ae905fd502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:48 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a12abcbf-9923-41bc-bf3b-db4423586955 tempest-VolumeDependencyTests-1150574786 None] Created volume successfully. Jul 03 01:27:48 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea" returned: 0 in 0.970s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74519881-463b-4bb5-b928-1852718eb22b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03f502a-5d41-4502-b701-a0a257243844]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:48 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b Jul 03 01:27:48 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:48 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-9d2ec974-0e04-4ba5-9e42-aca6efb6e892" returned: 0 in 0.779s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-9d2ec974-0e04-4ba5-9e42-aca6efb6e892" released by "delete_volume" :: held 1.783s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Created reservations ['961a840c-1387-4539-b801-fb468f03fde2', 'ffe8190a-e14b-4fc2-8a74-c54cad0e4454', '57b847e7-bc97-4a07-bb6e-068b81a8c81a', '92a8ba08-631f-4e0c-8a2d-aeebb9d7541c'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:48 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:48 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:48 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Flow 'volume_create_manager' (9d6eb444-8864-454a-ad20-e52871f5dc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d7fe77-914b-443f-acb9-9dfa74a90cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d7fe77-914b-443f-acb9-9dfa74a90cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801e0834-ee5a-4d53-be9d-c3f0a65f784b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b131355220df446a9ed641682632db80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:49Z,use_quota=True,user_id='0e75cc4d198d48d5b422763abeb92934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebffed6-cc26-4434-9082-21fe66f75de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebffed6-cc26-4434-9082-21fe66f75de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbda0052-6937-479b-9a42-fd6bae0b1a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.image.glance [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Creating Keystone auth plugin from conf {{(pid=86357) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-13fd424a-7f4a-4421-8611-8a9907540d51-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-13fd424a-7f4a-4421-8611-8a9907540d51-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-quobyte-13fd424a-7f4a-4421-8611-8a9907540d51" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-13fd424a-7f4a-4421-8611-8a9907540d51" acquired by "delete_volume" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[524bcf83-4096-4123-a264-949d729ea322]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-13fd424a-7f4a-4421-8611-8a9907540d51 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:49 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-13fd424a-7f4a-4421-8611-8a9907540d51 Jul 03 01:27:49 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:49 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b" returned: 0 in 1.042s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] Creating offline snapshot 28af08ea-8fb4-476c-8ad1-ace4dffcc3ca of volume 6e6b2d59-6eb0-4451-998d-e423c826e700 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:27:49 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea Jul 03 01:27:49 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b74ec6-410b-4e8b-8f3d-9a9f1bc9f2e8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:49 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 Jul 03 01:27:49 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbda0052-6937-479b-9a42-fd6bae0b1a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '801e0834-ee5a-4d53-be9d-c3f0a65f784b', 'volume_name': 'volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b', 'volume_size': 1, 'image_id': 'f11f7b5e-b390-43f4-8aff-f96876d0fb2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11f7b5e-b390-43f4-8aff-f96876d0fb2f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63645afc136d50a1d5c702c7a1048d43', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b131355220df446a9ed641682632db80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79820293a12afc1570b2b32fd0fb36cce68dc694d63707acc51212cb34ca7672d8a31a9ad38d7c57e76616aa23fe89c4ae42cddd5a21e172e7c8d00fa397632c', 'id': 'f11f7b5e-b390-43f4-8aff-f96876d0fb2f', 'created_at': datetime.datetime(2026, 7, 2, 23, 27, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 27, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11f7b5e-b390-43f4-8aff-f96876d0fb2f/file', 'properties': {}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:49 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec540fe-a68c-4e23-989a-e3004b165f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec540fe-a68c-4e23-989a-e3004b165f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417e5808-59df-4bc4-abfd-3f30432b9bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:49 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Volume 801e0834-ee5a-4d53-be9d-c3f0a65f784b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b', 'volume_size': 1, 'image_id': 'f11f7b5e-b390-43f4-8aff-f96876d0fb2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11f7b5e-b390-43f4-8aff-f96876d0fb2f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63645afc136d50a1d5c702c7a1048d43', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b131355220df446a9ed641682632db80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79820293a12afc1570b2b32fd0fb36cce68dc694d63707acc51212cb34ca7672d8a31a9ad38d7c57e76616aa23fe89c4ae42cddd5a21e172e7c8d00fa397632c', 'id': 'f11f7b5e-b390-43f4-8aff-f96876d0fb2f', 'created_at': datetime.datetime(2026, 7, 2, 23, 27, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 27, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11f7b5e-b390-43f4-8aff-f96876d0fb2f/file', 'properties': {}}, 'image_service': } Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Trying to clone 801e0834-ee5a-4d53-be9d-c3f0a65f784b from image f11f7b5e-b390-43f4-8aff-f96876d0fb2f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f11f7b5e-b390-43f4-8aff-f96876d0fb2f', 'metadata': {}}]). {{(pid=86357) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.984s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:49 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Deleted volume successfully. Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-b8619c4d-4603-45eb-8c49-a7215073a918 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-9d2ec974-0e04-4ba5-9e42-aca6efb6e892-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:49 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:27:49 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Image download 0.00 MB at 0.00 MB/s Jul 03 01:27:50 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[4630a720-d3b5-47b2-9b02-68abd89cf72b]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:50 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-13fd424a-7f4a-4421-8611-8a9907540d51" returned: 0 in 0.890s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:50 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD Jul 03 01:27:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-13fd424a-7f4a-4421-8611-8a9907540d51 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:50 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:50 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-13fd424a-7f4a-4421-8611-8a9907540d51 Jul 03 01:27:50 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:50 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700" returned: 0 in 0.997s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:50 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca 1G Jul 03 01:27:50 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:50 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea" returned: 0 in 1.145s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:50 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea Jul 03 01:27:50 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:50 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-13fd424a-7f4a-4421-8611-8a9907540d51" returned: 0 in 0.810s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:50 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD" returned: 0 in 0.954s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-13fd424a-7f4a-4421-8611-8a9907540d51" released by "delete_volume" :: held 1.817s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Created reservations ['e155913f-cd4c-4652-98b9-a8fd4100c82d', '74eee471-a4d1-4a42-9847-ae38f20d715e', 'dd57a18b-8df2-4eee-9793-138a96d21db0', '5ec3a1ed-2bf8-42b3-8163-fa29d524dfaa'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:51 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD Jul 03 01:27:51 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:51 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:51 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-c9f85886-3b59-4a48-a9d4-ce7285ce143f-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-c9f85886-3b59-4a48-a9d4-ce7285ce143f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-quobyte-5dd5f173-ba22-41f3-9cac-5bc4b38c70da" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-5dd5f173-ba22-41f3-9cac-5bc4b38c70da" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-quobyte-c9f85886-3b59-4a48-a9d4-ce7285ce143f" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-c9f85886-3b59-4a48-a9d4-ce7285ce143f" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Deleting offline snapshot c9f85886-3b59-4a48-a9d4-ce7285ce143f of volume 5dd5f173-ba22-41f3-9cac-5bc4b38c70da {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] snapshot_file for this snap is: volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e530a4fc-d964-4ae2-97ef-aaacd0a31af7]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:51 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca 1G" returned: 0 in 1.070s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6b2d59-6eb0-4451-998d-e423c826e700 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:51 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:51 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6b2d59-6eb0-4451-998d-e423c826e700 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca Jul 03 01:27:51 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b.1f97da86-c4bf-4a4c-bc88-83500cbe24ea" returned: 0 in 1.022s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-1f97da86-c4bf-4a4c-bc88-83500cbe24ea" released by "_delete_snapshot" :: held 4.317s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-74519881-463b-4bb5-b928-1852718eb22b" released by "delete_snapshot" :: held 4.361s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:51 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f Jul 03 01:27:51 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Created reservations ['83c0b313-af6e-474b-8bfb-3e2915a5e624', '2ff6469e-ad98-4a8b-9d12-2f29b172266e', 'e8fd0adf-3e90-4c46-b95d-d47ada4b5642', '3f428e15-0f23-4e95-8240-337c0ce626f4'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:51 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD" returned: 1 in 0.929s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Temporary image f11f7b5e-b390-43f4-8aff-f96876d0fb2f is fetched for user 0e75cc4d198d48d5b422763abeb92934. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:27:51 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Delete snapshot completed successfully. Jul 03 01:27:51 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-cadd9fc4-8bb9-4677-8d4a-41d1781e644f tempest-ProjectMemberTests-696766750 None] Lock "cinder-1f97da86-c4bf-4a4c-bc88-83500cbe24ea-delete_snapshot" released by "delete_snapshot" :: held 4.581s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f20a6e-8da5-437e-b666-3d0ed4358470]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:52 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.864s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:52 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Deleted volume successfully. Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d7b10ede-466c-410e-8607-766eaa7c2571 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-13fd424a-7f4a-4421-8611-8a9907540d51-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:52 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD Jul 03 01:27:52 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:52 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6b2d59-6eb0-4451-998d-e423c826e700 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca" returned: 0 in 0.865s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:52 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca is being set with open permissions: ugo+rw Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:52 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca Jul 03 01:27:52 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:52 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f" returned: 0 in 0.960s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[886f1a88-ed79-438b-b56a-2aaf86086503]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-74519881-463b-4bb5-b928-1852718eb22b-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Lock "cinder-74519881-463b-4bb5-b928-1852718eb22b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:52 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da Jul 03 01:27:52 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-74519881-463b-4bb5-b928-1852718eb22b" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-74519881-463b-4bb5-b928-1852718eb22b" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:52 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD" returned: 0 in 0.853s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e02170e-2c95-491b-8295-fa5cf136869e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:52 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD Jul 03 01:27:52 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:53 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b Jul 03 01:27:53 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:53 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca" returned: 0 in 0.822s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:53 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.info Jul 03 01:27:53 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:53 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da" returned: 0 in 0.917s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:53 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f Jul 03 01:27:53 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:53 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD" returned: 1 in 0.737s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:27:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:53 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b" returned: 0 in 0.923s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:53 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b Jul 03 01:27:53 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:54 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.info" returned: 0 in 0.743s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:54 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.info is being set with open permissions: ugo+rw Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:54 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.info Jul 03 01:27:54 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:54 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f" returned: 0 in 0.772s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:54 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f Jul 03 01:27:54 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:54 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-74519881-463b-4bb5-b928-1852718eb22b" returned: 0 in 0.734s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-74519881-463b-4bb5-b928-1852718eb22b" released by "delete_volume" :: held 1.735s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Created reservations ['118173b4-ee83-4356-bff7-6bb0b9e3cdae', '9cf2ad17-350c-4dad-94ca-14920d66067c', 'f7fd5807-577f-4232-9cea-60ccb5963808', '95c2d895-7b37-4396-91ec-0c84a269559c'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:54 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:54 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:54 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.info" returned: 0 in 0.734s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.368s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.273s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801e0834-ee5a-4d53-be9d-c3f0a65f784b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b131355220df446a9ed641682632db80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:49Z,use_quota=True,user_id='0e75cc4d198d48d5b422763abeb92934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Creating volume 801e0834-ee5a-4d53-be9d-c3f0a65f784b {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:54 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:54 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b 1073741824 Jul 03 01:27:54 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:54 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f59ef753-640b-4733-ade4-b0e10a2f1a56 tempest-VolumeDependencyTests-1150574786 None] Create snapshot completed successfully Jul 03 01:27:55 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da.c9f85886-3b59-4a48-a9d4-ce7285ce143f" returned: 0 in 0.760s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-c9f85886-3b59-4a48-a9d4-ce7285ce143f" released by "_delete_snapshot" :: held 3.575s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-5dd5f173-ba22-41f3-9cac-5bc4b38c70da" released by "delete_snapshot" :: held 3.623s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Created reservations ['60122f40-8240-4d16-8650-1212e0f51456', '843648fe-4fcc-448b-b8c6-726311e1d343', 'c3f92ff5-8295-4af0-ab8a-cada6ad279ff', 'f28c5376-3876-4fe6-9277-2b330cd2d53f'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:55 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Delete snapshot completed successfully. Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-29ecdf11-b697-49e0-b858-70dfbca4a03e tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-c9f85886-3b59-4a48-a9d4-ce7285ce143f-delete_snapshot" released by "delete_snapshot" :: held 3.948s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:55 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.746s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:55 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Deleted volume successfully. Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-71510418-369b-42c1-a109-bcc40de785b3 tempest-ProjectMemberTests-696766750 None] Lock "cinder-74519881-463b-4bb5-b928-1852718eb22b-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (a27c1bc3-3a01-4e67-94d6-b0422df02b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b027b20-f2e8-4ebc-bfa7-1f59283a2a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b027b20-f2e8-4ebc-bfa7-1f59283a2a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-55247564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83491ded-23e1-4155-9a64-d73742791b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:56Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e081282-c423-4b09-8650-299bd1f7793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e081282-c423-4b09-8650-299bd1f7793f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0898c99-b884-4ba3-9fdd-5a4f17c7171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0898c99-b884-4ba3-9fdd-5a4f17c7171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83491ded-23e1-4155-9a64-d73742791b79', 'volume_name': 'volume-83491ded-23e1-4155-9a64-d73742791b79', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b70da88-a1b8-4122-b7c3-0bfef84e6eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b70da88-a1b8-4122-b7c3-0bfef84e6eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80df70aa-b40c-4f5e-9af1-a8218ceebb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:55 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Volume 83491ded-23e1-4155-9a64-d73742791b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83491ded-23e1-4155-9a64-d73742791b79', 'volume_size': 1} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-5dd5f173-ba22-41f3-9cac-5bc4b38c70da-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-5dd5f173-ba22-41f3-9cac-5bc4b38c70da-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "cinder-quobyte-5dd5f173-ba22-41f3-9cac-5bc4b38c70da" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-5dd5f173-ba22-41f3-9cac-5bc4b38c70da" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[251d41ff-9399-4dee-831a-789204e9970b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:55 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b 1073741824" returned: 0 in 1.098s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:55 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da Jul 03 01:27:55 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:56 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b Jul 03 01:27:56 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Flow 'volume_create_manager' (540ff3fd-094a-4524-8552-9e70dde60fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84b9335-83c8-4770-8fed-6c3fc1a81fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84b9335-83c8-4770-8fed-6c3fc1a81fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-936605799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad80b96d-9e48-43c7-99ef-d340a3b5a8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842643b5637047b29ee922c8f6cc68e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=28af08ea-8fb4-476c-8ad1-ace4dffcc3ca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:56Z,use_quota=True,user_id='2dffe4709b934f66b457ff9f2b30a2a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe0a432-577c-4873-9def-53ddfaf39922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe0a432-577c-4873-9def-53ddfaf39922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5899103-d4ea-4d01-a896-e38636dd18ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5899103-d4ea-4d01-a896-e38636dd18ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad80b96d-9e48-43c7-99ef-d340a3b5a8f3', 'volume_name': 'volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3', 'volume_size': 1, 'snapshot_id': '28af08ea-8fb4-476c-8ad1-ace4dffcc3ca'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876dda1e-add0-4d8c-8de2-4bf495a4617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876dda1e-add0-4d8c-8de2-4bf495a4617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581859fb-1b34-420d-83cb-902139003376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:56 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Volume ad80b96d-9e48-43c7-99ef-d340a3b5a8f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3', 'volume_size': 1, 'snapshot_id': '28af08ea-8fb4-476c-8ad1-ace4dffcc3ca'} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:56 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da" returned: 0 in 0.850s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:56 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da Jul 03 01:27:56 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:56 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b" returned: 0 in 0.730s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.046s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-55247564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83491ded-23e1-4155-9a64-d73742791b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:56Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Creating volume 83491ded-23e1-4155-9a64-d73742791b79 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:56 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:56 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79 1073741824 Jul 03 01:27:56 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Attempting download of f11f7b5e-b390-43f4-8aff-f96876d0fb2f ((None, [{'url': 'file:///opt/stack/data/glance/images/f11f7b5e-b390-43f4-8aff-f96876d0fb2f', 'metadata': {}}])) to volume 801e0834-ee5a-4d53-be9d-c3f0a65f784b. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[68420b97-d9d8-442f-b587-847dd4f537d8]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_knxgtueo {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:56 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_knxgtueo Jul 03 01:27:56 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:57 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-5dd5f173-ba22-41f3-9cac-5bc4b38c70da" returned: 0 in 0.703s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-quobyte-5dd5f173-ba22-41f3-9cac-5bc4b38c70da" released by "delete_volume" :: held 1.613s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:57 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Created reservations ['f7747d8c-f0cb-4a63-bc39-28670b6c16f0', 'f0583885-423f-4ee9-953d-d15f4aa55041', 'df18832c-5aaf-46fe-8f0b-ec103eff18dc', '5eb86b18-e30e-46f5-8f90-1731689623c6'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:57 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:27:57 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:57 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79 1073741824" returned: 0 in 0.887s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:57 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_knxgtueo" returned: 0 in 0.810s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_knxgtueo {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:57 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79 Jul 03 01:27:57 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:57 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_knxgtueo Jul 03 01:27:57 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:58 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.712s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:58 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Deleted volume successfully. Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-873d0cb9-28de-47fb-be4e-6c3886091bf1 tempest-CreateVolumesFromSnapshotTest-1639480290 None] Lock "cinder-5dd5f173-ba22-41f3-9cac-5bc4b38c70da-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:58 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79" returned: 0 in 0.813s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.077s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "cinder-quobyte-28af08ea-8fb4-476c-8ad1-ace4dffcc3ca-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3" by "_create_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80df70aa-b40c-4f5e-9af1-a8218ceebb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83491ded-23e1-4155-9a64-d73742791b79', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a938a62d-bda3-40d2-94c0-73bceeaed329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:58 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_knxgtueo" returned: 1 in 0.883s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_knxgtueo' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-quobyte-28af08ea-8fb4-476c-8ad1-ace4dffcc3ca-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Creating volume ad80b96d-9e48-43c7-99ef-d340a3b5a8f3 from snapshot 28af08ea-8fb4-476c-8ad1-ace4dffcc3ca {{(pid=86357) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "cinder-quobyte-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3" by "_copy_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc414f9-f16a-4664-9876-c8cbc240e5fd]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:58 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Volume volume-83491ded-23e1-4155-9a64-d73742791b79 (83491ded-23e1-4155-9a64-d73742791b79): created successfully Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a938a62d-bda3-40d2-94c0-73bceeaed329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (a27c1bc3-3a01-4e67-94d6-b0422df02b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=228,cinder:SELECT=182,cinder:INSERT=65,cinder:DELETE=18 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-quobyte-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] snapshot: 28af08ea-8fb4-476c-8ad1-ace4dffcc3ca, volume: ad80b96d-9e48-43c7-99ef-d340a3b5a8f3, {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:27:58 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a6e391e5-37d5-4292-bab6-e2b1648af9b5 tempest-ProjectMemberTests-696766750 None] Created volume successfully. Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d532e4-f35b-45a8-aa62-eac1382e76ec]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:58 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD Jul 03 01:27:58 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:58 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca Jul 03 01:27:58 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:59 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=158,cinder:UPDATE=242,cinder:INSERT=55,cinder:DELETE=25 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:27:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:59 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD" returned: 0 in 0.994s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:59 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD Jul 03 01:27:59 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:59 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca" returned: 0 in 1.021s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:59 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e6b2d59-6eb0-4451-998d-e423c826e700(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:27:59 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:27:59 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Creating direct copy from snapshot {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:27:59 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ecfdea-ccfe-46ed-9f98-1ef36ea84065]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:59 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 Jul 03 01:27:59 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:00 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD" returned: 1 in 0.758s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:28:00 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] f11f7b5e-b390-43f4-8aff-f96876d0fb2f was raw, converting to raw {{(pid=86357) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:28:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:00 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b Jul 03 01:28:00 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:00 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700" returned: 0 in 0.888s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:00 devstack cinder-volume[86357]: DEBUG cinder.utils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Path /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3 not found in is_blk_device check {{(pid=86357) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:28:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:00 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3 Jul 03 01:28:00 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:01 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b" returned: 0 in 0.877s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:01 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f11f7b5e-b390-43f4-8aff-f96876d0fb2f_ok7hrl1odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:28:01 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 01:28:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:01 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b 1G Jul 03 01:28:01 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:02 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b 1G" returned: 0 in 1.382s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:02 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99aa0e0-8a0c-4ee7-8fec-ae1172805a16]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:02 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b Jul 03 01:28:02 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:04 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b" returned: 0 in 2.038s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:05 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b Jul 03 01:28:05 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:06 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b" returned: 1 in 1.435s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Downloaded image f11f7b5e-b390-43f4-8aff-f96876d0fb2f ((None, [{'url': 'file:///opt/stack/data/glance/images/f11f7b5e-b390-43f4-8aff-f96876d0fb2f', 'metadata': {}}])) to volume 801e0834-ee5a-4d53-be9d-c3f0a65f784b successfully. {{(pid=86357) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Temporary image f11f7b5e-b390-43f4-8aff-f96876d0fb2f for user 0e75cc4d198d48d5b422763abeb92934 is deleted. {{(pid=86357) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG cinder.volume.volume_utils [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Marking volume 801e0834-ee5a-4d53-be9d-c3f0a65f784b as bootable. {{(pid=86357) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Copying metadata from image f11f7b5e-b390-43f4-8aff-f96876d0fb2f to 801e0834-ee5a-4d53-be9d-c3f0a65f784b. {{(pid=86357) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Creating volume glance metadata for volume 801e0834-ee5a-4d53-be9d-c3f0a65f784b backed by image f11f7b5e-b390-43f4-8aff-f96876d0fb2f with: {'image_id': 'f11f7b5e-b390-43f4-8aff-f96876d0fb2f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '63645afc136d50a1d5c702c7a1048d43', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86357) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:28:06 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3" returned: 0 in 5.607s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[920e9d73-55f3-48c8-8239-63696edf448c]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417e5808-59df-4bc4-abfd-3f30432b9bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b', 'volume_size': 1, 'image_id': 'f11f7b5e-b390-43f4-8aff-f96876d0fb2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f11f7b5e-b390-43f4-8aff-f96876d0fb2f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63645afc136d50a1d5c702c7a1048d43', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b131355220df446a9ed641682632db80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79820293a12afc1570b2b32fd0fb36cce68dc694d63707acc51212cb34ca7672d8a31a9ad38d7c57e76616aa23fe89c4ae42cddd5a21e172e7c8d00fa397632c', 'id': 'f11f7b5e-b390-43f4-8aff-f96876d0fb2f', 'created_at': datetime.datetime(2026, 7, 2, 23, 27, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 27, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f11f7b5e-b390-43f4-8aff-f96876d0fb2f/file', 'properties': {}}, 'image_service': }' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397dd69c-7f82-43b9-aca6-b00c7896ca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:06 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Volume volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b (801e0834-ee5a-4d53-be9d-c3f0a65f784b): created successfully Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397dd69c-7f82-43b9-aca6-b00c7896ca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Flow 'volume_create_manager' (9d6eb444-8864-454a-ad20-e52871f5dc2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:06 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-543320ab-75a5-4048-bb3d-699b45d9468d tempest-VolumeImageDependencyTests-345241462 None] Created volume successfully. Jul 03 01:28:06 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 Jul 03 01:28:06 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Acquiring lock "cinder-801e0834-ee5a-4d53-be9d-c3f0a65f784b-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Lock "cinder-801e0834-ee5a-4d53-be9d-c3f0a65f784b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Acquiring lock "cinder-quobyte-801e0834-ee5a-4d53-be9d-c3f0a65f784b" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Lock "cinder-quobyte-801e0834-ee5a-4d53-be9d-c3f0a65f784b" acquired by "delete_volume" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be7a86e-0832-4245-9e07-2dfdc9186a9d]: (4, 'raw') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:07 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b Jul 03 01:28:07 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:07 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700" returned: 0 in 1.052s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:07 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3 {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:28:07 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Converted 1024.00 MB image at 182.61 MB/s Jul 03 01:28:07 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3 is being set with open permissions: ugo+rw Jul 03 01:28:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:07 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3 Jul 03 01:28:07 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:07 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b" returned: 0 in 0.904s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:08 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b Jul 03 01:28:08 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:08 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3" returned: 0 in 0.767s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-quobyte-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3" released by "_copy_volume_from_snapshot" :: held 9.508s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-quobyte-28af08ea-8fb4-476c-8ad1-ace4dffcc3ca-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3" released by "_create_volume_from_snapshot" :: held 9.573s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.617s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.056s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] Creating offline snapshot 8182aa90-e457-4997-8e57-ee346ff93eee of volume 83491ded-23e1-4155-9a64-d73742791b79 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581859fb-1b34-420d-83cb-902139003376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3', 'volume_size': 1, 'snapshot_id': '28af08ea-8fb4-476c-8ad1-ace4dffcc3ca'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc07be7-6fbb-482b-839b-477299f28c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ce7fde-f8d2-40f3-8f43-65213cf7b38e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:08 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Volume volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3 (ad80b96d-9e48-43c7-99ef-d340a3b5a8f3): created successfully Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc07be7-6fbb-482b-839b-477299f28c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Flow 'volume_create_manager' (540ff3fd-094a-4524-8552-9e70dde60fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:08 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-abce493f-739f-43fc-84d0-76346a506d9a tempest-VolumeDependencyTests-1150574786 None] Created volume successfully. Jul 03 01:28:08 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79 Jul 03 01:28:08 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "cinder-28af08ea-8fb4-476c-8ad1-ace4dffcc3ca-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-28af08ea-8fb4-476c-8ad1-ace4dffcc3ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "cinder-quobyte-6e6b2d59-6eb0-4451-998d-e423c826e700" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-quobyte-6e6b2d59-6eb0-4451-998d-e423c826e700" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "cinder-quobyte-28af08ea-8fb4-476c-8ad1-ace4dffcc3ca" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-quobyte-28af08ea-8fb4-476c-8ad1-ace4dffcc3ca" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Deleting offline snapshot 28af08ea-8fb4-476c-8ad1-ace4dffcc3ca of volume 6e6b2d59-6eb0-4451-998d-e423c826e700 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] snapshot_file for this snap is: volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dd4e99-206d-4759-a27d-54098ee50d7b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:08 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b" returned: 1 in 0.902s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b' failed. Not Retrying. {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:28:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:08 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b Jul 03 01:28:08 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:08 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca Jul 03 01:28:08 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:09 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79" returned: 0 in 0.927s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:09 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee 1G Jul 03 01:28:09 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:09 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-801e0834-ee5a-4d53-be9d-c3f0a65f784b" returned: 0 in 0.810s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Lock "cinder-quobyte-801e0834-ee5a-4d53-be9d-c3f0a65f784b" released by "delete_volume" :: held 2.700s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:09 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca" returned: 0 in 0.963s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e6b2d59-6eb0-4451-998d-e423c826e700(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[217797b7-b7d0-4060-b101-30bacf08201a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Created reservations ['ac466652-a62a-40d5-8401-c672c46322d5', 'a6887fc9-f1d5-4ddd-8466-e1bf655874a2', '8cecb55a-7bdb-410d-ba17-083790f4e5b4', 'b7901ee2-694b-4c7f-b0f9-7941e8165092'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:09 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 Jul 03 01:28:09 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:09 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:09 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Flow 'volume_create_manager' (ddba1b50-3229-4ccf-af41-9027212eccd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd6dd1d-c4e8-4128-8ca7-846e69b4d03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd6dd1d-c4e8-4128-8ca7-846e69b4d03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-800943480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdfb1171-a8be-4672-b2f1-f4e86ff93782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c687e8063ccc4b0898549b095e0caf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:10Z,use_quota=True,user_id='c82ca2fcc7364940a3af049c64401c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b15ff8-f36e-464f-93ea-741c73ffd9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b15ff8-f36e-464f-93ea-741c73ffd9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12cff999-16f0-42bf-a949-ec0592416da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12cff999-16f0-42bf-a949-ec0592416da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdfb1171-a8be-4672-b2f1-f4e86ff93782', 'volume_name': 'volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa18bba0-9239-49e1-b211-d7545d6d06fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa18bba0-9239-49e1-b211-d7545d6d06fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940ce4eb-fc5c-4526-9f7b-7eb09cd81e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:10 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Volume fdfb1171-a8be-4672-b2f1-f4e86ff93782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782', 'volume_size': 1} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:10 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee 1G" returned: 0 in 1.025s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83491ded-23e1-4155-9a64-d73742791b79 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:10 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83491ded-23e1-4155-9a64-d73742791b79 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee Jul 03 01:28:10 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:10 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.760s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:10 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Deleted volume successfully. Jul 03 01:28:10 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700" returned: 0 in 0.953s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dc5d9aa9-9363-408e-9d14-c8737bc0a261 tempest-VolumeImageDependencyTests-345241462 None] Lock "cinder-801e0834-ee5a-4d53-be9d-c3f0a65f784b-delete_volume" released by "delete_volume" :: held 3.829s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:10 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca Jul 03 01:28:10 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:10 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83491ded-23e1-4155-9a64-d73742791b79 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee" returned: 0 in 0.799s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:10 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee is being set with open permissions: ugo+rw Jul 03 01:28:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:10 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee Jul 03 01:28:10 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:11 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca" returned: 0 in 0.866s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:11 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca Jul 03 01:28:11 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:11 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee" returned: 0 in 0.734s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:11 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.info Jul 03 01:28:11 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:12 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700.28af08ea-8fb4-476c-8ad1-ace4dffcc3ca" returned: 0 in 0.744s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-quobyte-28af08ea-8fb4-476c-8ad1-ace4dffcc3ca" released by "_delete_snapshot" :: held 3.654s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-quobyte-6e6b2d59-6eb0-4451-998d-e423c826e700" released by "delete_snapshot" :: held 3.689s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:12 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Created reservations ['3a78da3f-2a23-4063-93b3-5a337fbcb44c', '21cdc8d3-aa82-4c48-ad6d-20f332409de6', '93facac4-7230-4b79-a4eb-affb67cbef5a', 'face59c0-d38e-4bbb-919e-9e8f4ed415e0'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:12 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Delete snapshot completed successfully. Jul 03 01:28:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7b6c7ff5-c816-493c-a903-5e7c5482d45c tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-28af08ea-8fb4-476c-8ad1-ace4dffcc3ca-delete_snapshot" released by "delete_snapshot" :: held 3.868s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:12 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.info" returned: 0 in 0.766s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:12 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.info is being set with open permissions: ugo+rw Jul 03 01:28:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:12 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.info Jul 03 01:28:12 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "cinder-6e6b2d59-6eb0-4451-998d-e423c826e700-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-6e6b2d59-6eb0-4451-998d-e423c826e700-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "cinder-quobyte-6e6b2d59-6eb0-4451-998d-e423c826e700" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-quobyte-6e6b2d59-6eb0-4451-998d-e423c826e700" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cdfcbf-fa48-4bfb-bca4-ecf8e520c391]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:13 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 Jul 03 01:28:13 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:13 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.info" returned: 0 in 0.704s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.081s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.106s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-800943480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdfb1171-a8be-4672-b2f1-f4e86ff93782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c687e8063ccc4b0898549b095e0caf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:10Z,use_quota=True,user_id='c82ca2fcc7364940a3af049c64401c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Creating volume fdfb1171-a8be-4672-b2f1-f4e86ff93782 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:13 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:13 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782 1073741824 Jul 03 01:28:13 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9cc1e0dd-bb0e-42cc-bd07-5a2da995b78f tempest-ProjectMemberTests-696766750 None] Create snapshot completed successfully Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-8182aa90-e457-4997-8e57-ee346ff93eee-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:13 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700" returned: 0 in 0.835s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Lock "cinder-8182aa90-e457-4997-8e57-ee346ff93eee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-83491ded-23e1-4155-9a64-d73742791b79" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:13 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700 Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-83491ded-23e1-4155-9a64-d73742791b79" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-8182aa90-e457-4997-8e57-ee346ff93eee" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:13 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-8182aa90-e457-4997-8e57-ee346ff93eee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Deleting offline snapshot 8182aa90-e457-4997-8e57-ee346ff93eee of volume 83491ded-23e1-4155-9a64-d73742791b79 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] snapshot_file for this snap is: volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a19c72-1346-4054-85bd-de47b2c95d57]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:14 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee Jul 03 01:28:14 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:14 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782 1073741824" returned: 0 in 1.011s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:14 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782 Jul 03 01:28:14 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:14 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-6e6b2d59-6eb0-4451-998d-e423c826e700" returned: 0 in 0.812s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-quobyte-6e6b2d59-6eb0-4451-998d-e423c826e700" released by "delete_volume" :: held 1.731s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Created reservations ['1e3c39cc-33de-486a-926b-0232fa331bae', 'a667c1c0-f14e-4735-a0de-84ea347dd2aa', '5f40da38-08fe-4fa8-9018-f58f67dea2d1', 'fc6d7e34-3ef2-4391-99d2-63b9e1440891'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:14 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:14 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:14 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee" returned: 0 in 0.970s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:14 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83491ded-23e1-4155-9a64-d73742791b79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3591a543-97cd-4dff-9eb9-47add87a3e8e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:15 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782" returned: 0 in 0.768s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940ce4eb-fc5c-4526-9f7b-7eb09cd81e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7228b521-fca2-4749-a28a-2ba8436223de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:15 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Volume volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782 (fdfb1171-a8be-4672-b2f1-f4e86ff93782): created successfully Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7228b521-fca2-4749-a28a-2ba8436223de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Flow 'volume_create_manager' (ddba1b50-3229-4ccf-af41-9027212eccd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:15 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d28f69b2-a075-4538-b5c1-80c6c5e15f6b tempest-ProjectReaderTests-726959915 None] Created volume successfully. Jul 03 01:28:15 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79 Jul 03 01:28:15 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "cinder-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "cinder-quobyte-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-quobyte-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3" acquired by "delete_volume" :: waited 0.024s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6d968b-9561-44a7-adab-b199b0a25cd3]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:15 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3 Jul 03 01:28:15 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Acquiring lock "cinder-fdfb1171-a8be-4672-b2f1-f4e86ff93782-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Lock "cinder-fdfb1171-a8be-4672-b2f1-f4e86ff93782-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Acquiring lock "cinder-quobyte-fdfb1171-a8be-4672-b2f1-f4e86ff93782" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Lock "cinder-quobyte-fdfb1171-a8be-4672-b2f1-f4e86ff93782" acquired by "delete_volume" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cc25b5-223b-409d-8919-e2d5040e908b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:15 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.934s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:15 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Deleted volume successfully. Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-65683498-c187-44c3-a9fa-148299c0ac29 tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-6e6b2d59-6eb0-4451-998d-e423c826e700-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:15 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782 Jul 03 01:28:15 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:15 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79" returned: 0 in 0.934s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:16 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee Jul 03 01:28:16 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:16 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3" returned: 0 in 0.984s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:16 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3 Jul 03 01:28:16 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:16 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782" returned: 0 in 1.104s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:16 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782 Jul 03 01:28:16 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:16 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee" returned: 0 in 0.934s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:16 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee Jul 03 01:28:16 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:17 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3" returned: 0 in 0.795s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-quobyte-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3" released by "delete_volume" :: held 1.825s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Created reservations ['d471ea73-fd45-41b0-9ad1-3df51a5d4048', '8dc811ac-9630-451c-92c9-930df6c15fca', '902b2269-a411-40ff-8d58-1c69601b3c75', 'a97110db-87a8-4857-82bf-bdd7abdd32ee'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:17 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:17 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:17 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdfb1171-a8be-4672-b2f1-f4e86ff93782" returned: 0 in 0.689s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Lock "cinder-quobyte-fdfb1171-a8be-4672-b2f1-f4e86ff93782" released by "delete_volume" :: held 1.855s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Created reservations ['a3b4e343-3f2e-406c-8799-36345fd5a73e', '6398b6c6-ce4d-4924-a0d5-87d5b0e10f69', '3c272a63-3fc5-4361-94a5-4797b8739dca', 'f716427d-1a1d-464a-87fc-7b0e159909fe'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:17 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79.8182aa90-e457-4997-8e57-ee346ff93eee" returned: 0 in 0.763s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-8182aa90-e457-4997-8e57-ee346ff93eee" released by "_delete_snapshot" :: held 3.777s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-83491ded-23e1-4155-9a64-d73742791b79" released by "delete_snapshot" :: held 3.811s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:17 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:17 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Created reservations ['ef00e896-957b-4d84-b28d-53a5aefdef05', 'e412107a-c20c-4750-a1e6-55f37a2c4ac3', 'b406b3f6-17f1-4811-ab9f-1ade77abe72a', 'ba7a97e7-da02-421c-9d9a-9ba68fa922ed'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:17 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Delete snapshot completed successfully. Jul 03 01:28:17 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b995d5-eae6-4d59-835d-4534b839ec8d tempest-ProjectMemberTests-696766750 None] Lock "cinder-8182aa90-e457-4997-8e57-ee346ff93eee-delete_snapshot" released by "delete_snapshot" :: held 3.990s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:18 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.094s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:18 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Deleted volume successfully. Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1d4d2ff0-d235-42dc-ba72-56e6bbd9e5e4 tempest-VolumeDependencyTests-1150574786 None] Lock "cinder-ad80b96d-9e48-43c7-99ef-d340a3b5a8f3-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-83491ded-23e1-4155-9a64-d73742791b79-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Lock "cinder-83491ded-23e1-4155-9a64-d73742791b79-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-83491ded-23e1-4155-9a64-d73742791b79" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-83491ded-23e1-4155-9a64-d73742791b79" acquired by "delete_volume" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[deebf401-b9ff-408f-a1b8-05cf8ca2cfa5]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Flow 'volume_create_manager' (8f0c3881-85ab-4666-afd4-6c94db8420d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c27cfaf-8693-4077-ac60-f9d439911a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:18 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c27cfaf-8693-4077-ac60-f9d439911a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1208931008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f8cc93-2d04-4065-9f73-a3c39a9e7e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c687e8063ccc4b0898549b095e0caf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:19Z,use_quota=True,user_id='c82ca2fcc7364940a3af049c64401c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:18 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79 Jul 03 01:28:18 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9af1015-7d81-41a2-908e-d809f97af797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9af1015-7d81-41a2-908e-d809f97af797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7011b1f8-8359-4bba-aab4-fd6b3969462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7011b1f8-8359-4bba-aab4-fd6b3969462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09f8cc93-2d04-4065-9f73-a3c39a9e7e81', 'volume_name': 'volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c0ec7b-956a-407e-b8cd-d02e1bac65ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c0ec7b-956a-407e-b8cd-d02e1bac65ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d07d7af-2bac-44df-b9b3-1320c342b9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:18 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Volume 09f8cc93-2d04-4065-9f73-a3c39a9e7e81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81', 'volume_size': 1} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1208931008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f8cc93-2d04-4065-9f73-a3c39a9e7e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c687e8063ccc4b0898549b095e0caf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:19Z,use_quota=True,user_id='c82ca2fcc7364940a3af049c64401c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Creating volume 09f8cc93-2d04-4065-9f73-a3c39a9e7e81 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:18 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.266s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:18 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:18 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Deleted volume successfully. Jul 03 01:28:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5fc13b91-457b-4fb0-a99b-15327b312e00 tempest-ProjectReaderTests-726959915 None] Lock "cinder-fdfb1171-a8be-4672-b2f1-f4e86ff93782-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:19 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81 1073741824 Jul 03 01:28:19 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:19 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79" returned: 0 in 1.079s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:19 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79 Jul 03 01:28:19 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:19 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81 1073741824" returned: 0 in 1.002s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:20 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81 Jul 03 01:28:20 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:20 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-83491ded-23e1-4155-9a64-d73742791b79" returned: 0 in 0.747s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-83491ded-23e1-4155-9a64-d73742791b79" released by "delete_volume" :: held 1.919s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Created reservations ['5cc1510f-b9ed-40fd-ba07-01ec65fe4616', 'd65f427c-c32a-49e7-982a-668e2ea3ca9f', '88fe37b0-8638-493a-b044-94ba666f4e2b', 'a4393d91-7e7d-4c22-9cf2-8746e2cf5870'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:20 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81" returned: 0 in 0.794s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d07d7af-2bac-44df-b9b3-1320c342b9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:20 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5a6e5b-5cde-440a-ba6c-92f0323d4729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:20 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:20 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Volume volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81 (09f8cc93-2d04-4065-9f73-a3c39a9e7e81): created successfully Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5a6e5b-5cde-440a-ba6c-92f0323d4729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Flow 'volume_create_manager' (8f0c3881-85ab-4666-afd4-6c94db8420d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:20 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-693f64b9-43cb-4bf1-8fe8-607627a4ef08 tempest-ProjectReaderTests-726959915 None] Created volume successfully. Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Flow 'volume_create_manager' (0099758d-a0e8-474a-ad63-62ccbae09705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235d10d0-845a-4781-b097-4ca6a34bac12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235d10d0-845a-4781-b097-4ca6a34bac12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62227cb2-e631-453d-9247-1d594f77e3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a181e65c3f44afb6097a9bdfd14c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:22Z,use_quota=True,user_id='ccc08eaa958145809932da484dcd9ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef682e2-0ed7-4cdc-b5af-311449fb4880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef682e2-0ed7-4cdc-b5af-311449fb4880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9fe12f-3039-43f5-9642-7632ca51eb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9fe12f-3039-43f5-9642-7632ca51eb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62227cb2-e631-453d-9247-1d594f77e3ec', 'volume_name': 'volume-62227cb2-e631-453d-9247-1d594f77e3ec', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487622a2-49cb-4838-b88e-6610119f79a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487622a2-49cb-4838-b88e-6610119f79a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc7b2de-ade8-43f4-8dc9-d9bf7ce030bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:21 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Volume 62227cb2-e631-453d-9247-1d594f77e3ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62227cb2-e631-453d-9247-1d594f77e3ec', 'volume_size': 1} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:21 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62227cb2-e631-453d-9247-1d594f77e3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a181e65c3f44afb6097a9bdfd14c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:22Z,use_quota=True,user_id='ccc08eaa958145809932da484dcd9ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Creating volume 62227cb2-e631-453d-9247-1d594f77e3ec {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:21 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-62227cb2-e631-453d-9247-1d594f77e3ec 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Acquiring lock "cinder-09f8cc93-2d04-4065-9f73-a3c39a9e7e81-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 1.057s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:21 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-62227cb2-e631-453d-9247-1d594f77e3ec 1073741824 Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:21 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:21 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Deleted volume successfully. Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Lock "cinder-09f8cc93-2d04-4065-9f73-a3c39a9e7e81-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (280a333f-c287-46c1-9282-8105196226d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a445ce19-a9d4-41a9-8672-a21a9c1965f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8e9bb8aa-216a-41bb-8439-3a7b413fc4f4 tempest-ProjectMemberTests-696766750 None] Lock "cinder-83491ded-23e1-4155-9a64-d73742791b79-delete_volume" released by "delete_volume" :: held 3.382s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a445ce19-a9d4-41a9-8672-a21a9c1965f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192032339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee43f87f-3176-4e2c-846e-a045897ad632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:22Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ae2f88-f57d-403c-b87a-d18b9b8e9f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ae2f88-f57d-403c-b87a-d18b9b8e9f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae00b7a-f114-4470-8cdc-fc891fdfe77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae00b7a-f114-4470-8cdc-fc891fdfe77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee43f87f-3176-4e2c-846e-a045897ad632', 'volume_name': 'volume-ee43f87f-3176-4e2c-846e-a045897ad632', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7406f90e-16fe-4b0a-9b95-055295a51ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7406f90e-16fe-4b0a-9b95-055295a51ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:22 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c905476-41b2-4642-83da-40de097d1446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:22 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Volume ee43f87f-3176-4e2c-846e-a045897ad632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee43f87f-3176-4e2c-846e-a045897ad632', 'volume_size': 1} Jul 03 01:28:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Acquiring lock "cinder-quobyte-09f8cc93-2d04-4065-9f73-a3c39a9e7e81" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Lock "cinder-quobyte-09f8cc93-2d04-4065-9f73-a3c39a9e7e81" acquired by "delete_volume" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:22 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fe7f73-7836-49ee-8141-3eb5a0d528f6]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:22 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81 Jul 03 01:28:22 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:22 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-62227cb2-e631-453d-9247-1d594f77e3ec 1073741824" returned: 0 in 1.022s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-62227cb2-e631-453d-9247-1d594f77e3ec {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:22 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-62227cb2-e631-453d-9247-1d594f77e3ec Jul 03 01:28:22 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:22 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81" returned: 0 in 0.909s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:23 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81 Jul 03 01:28:23 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:23 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-62227cb2-e631-453d-9247-1d594f77e3ec" returned: 0 in 0.644s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.524s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192032339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee43f87f-3176-4e2c-846e-a045897ad632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:22Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Creating volume ee43f87f-3176-4e2c-846e-a045897ad632 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:23 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc7b2de-ade8-43f4-8dc9-d9bf7ce030bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62227cb2-e631-453d-9247-1d594f77e3ec', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc5d744-751f-4859-ba4f-272cd2d2e450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:23 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632 1073741824 Jul 03 01:28:23 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:23 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Volume volume-62227cb2-e631-453d-9247-1d594f77e3ec (62227cb2-e631-453d-9247-1d594f77e3ec): created successfully Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc5d744-751f-4859-ba4f-272cd2d2e450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Flow 'volume_create_manager' (0099758d-a0e8-474a-ad63-62ccbae09705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:23 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-bed74258-c168-4354-86bd-81fffc811c0d tempest-CinderUnicodeTest-1353016978 None] Created volume successfully. Jul 03 01:28:23 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-09f8cc93-2d04-4065-9f73-a3c39a9e7e81" returned: 0 in 0.677s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Lock "cinder-quobyte-09f8cc93-2d04-4065-9f73-a3c39a9e7e81" released by "delete_volume" :: held 1.636s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Created reservations ['844b8412-0988-479c-873d-4c4b441a9ad9', 'd98e0ca6-1530-4b13-a5b8-21f853bcfac8', 'ac7a1826-2875-49bc-9a07-5366b12e77e9', '494a914d-9364-4233-b7b2-b53d1bae148f'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:23 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:23 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:24 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632 1073741824" returned: 0 in 0.891s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:24 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.684s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:24 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:24 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Deleted volume successfully. Jul 03 01:28:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fc8b54fd-a25e-4c44-b36b-b6097fab9376 tempest-ProjectReaderTests-726959915 None] Lock "cinder-09f8cc93-2d04-4065-9f73-a3c39a9e7e81-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:24 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632 Jul 03 01:28:24 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Flow 'volume_create_manager' (c69ae640-8396-4724-80fc-e7c94e151816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cee954e-c140-404c-ac7c-997e464b46a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:25 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632" returned: 0 in 0.795s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cee954e-c140-404c-ac7c-997e464b46a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-731890033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c4904a-7946-4729-bb9d-a5d898354c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a181e65c3f44afb6097a9bdfd14c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:25Z,use_quota=True,user_id='ccc08eaa958145809932da484dcd9ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a4b73e-a812-47d0-b31b-3ae2e09fd4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a4b73e-a812-47d0-b31b-3ae2e09fd4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54b766c-323f-47d9-8057-ff812e5a767d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54b766c-323f-47d9-8057-ff812e5a767d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c4904a-7946-4729-bb9d-a5d898354c8d', 'volume_name': 'volume-b2c4904a-7946-4729-bb9d-a5d898354c8d', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6249af15-f141-40a0-a84e-4f7fd9da0db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6249af15-f141-40a0-a84e-4f7fd9da0db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52070d5f-e16b-43ef-ab91-f6e9f52f4ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:25 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Volume b2c4904a-7946-4729-bb9d-a5d898354c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c4904a-7946-4729-bb9d-a5d898354c8d', 'volume_size': 1} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-731890033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c4904a-7946-4729-bb9d-a5d898354c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09a181e65c3f44afb6097a9bdfd14c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:25Z,use_quota=True,user_id='ccc08eaa958145809932da484dcd9ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Creating volume b2c4904a-7946-4729-bb9d-a5d898354c8d {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:25 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c905476-41b2-4642-83da-40de097d1446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee43f87f-3176-4e2c-846e-a045897ad632', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:25 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d 1073741824 Jul 03 01:28:25 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d325e44-c3a1-4707-a380-479bb5ca6e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:25 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Volume volume-ee43f87f-3176-4e2c-846e-a045897ad632 (ee43f87f-3176-4e2c-846e-a045897ad632): created successfully Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d325e44-c3a1-4707-a380-479bb5ca6e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (280a333f-c287-46c1-9282-8105196226d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-80a4d4b6-3022-4ead-a6a3-71c55e8243af tempest-ProjectMemberTests-696766750 None] Created volume successfully. Jul 03 01:28:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:26 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d 1073741824" returned: 0 in 0.934s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:26 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d Jul 03 01:28:26 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:26 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d" returned: 0 in 0.675s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] Creating offline snapshot 4d4f5458-9f34-40e7-a951-4fde80bd04cb of volume ee43f87f-3176-4e2c-846e-a045897ad632 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52070d5f-e16b-43ef-ab91-f6e9f52f4ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c4904a-7946-4729-bb9d-a5d898354c8d', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c01daa-85b8-438e-9751-84b8c6b40fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c0d25f-a33d-43bc-b953-96ae3f86f207]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:27 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Volume volume-b2c4904a-7946-4729-bb9d-a5d898354c8d (b2c4904a-7946-4729-bb9d-a5d898354c8d): created successfully Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c01daa-85b8-438e-9751-84b8c6b40fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Flow 'volume_create_manager' (c69ae640-8396-4724-80fc-e7c94e151816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:27 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a6911a75-95b6-435d-95c3-da4dad0276c7 tempest-CinderUnicodeTest-1353016978 None] Created volume successfully. Jul 03 01:28:27 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632 Jul 03 01:28:27 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:27 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632" returned: 0 in 0.863s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:27 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:27 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:27 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb 1G Jul 03 01:28:27 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Flow 'volume_create_manager' (f331c6e3-5fd6-4359-a4cd-3919c81c99bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feaffe57-a785-4f96-a5ad-e41f10876069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feaffe57-a785-4f96-a5ad-e41f10876069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324461420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ef2399-4dcd-473d-b21a-fbb3bde9b585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c10f5ba04764e8698ca794ae03a9049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:28Z,use_quota=True,user_id='908eac548ad749e7b79dca8a3d50c397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8539f9b3-213c-4043-95a5-e3162540f128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8539f9b3-213c-4043-95a5-e3162540f128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd2995d-77e2-4c57-bc26-b386ed52cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd2995d-77e2-4c57-bc26-b386ed52cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39ef2399-4dcd-473d-b21a-fbb3bde9b585', 'volume_name': 'volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e13c55-d57b-474e-b6b2-a353b805a80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e13c55-d57b-474e-b6b2-a353b805a80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85455fad-558c-493a-969a-79d921fdf319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:28 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Volume 39ef2399-4dcd-473d-b21a-fbb3bde9b585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585', 'volume_size': 1} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:28 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.686s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:28:28 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb 1G" returned: 0 in 0.849s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee43f87f-3176-4e2c-846e-a045897ad632 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:28 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee43f87f-3176-4e2c-846e-a045897ad632 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb Jul 03 01:28:28 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:29 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee43f87f-3176-4e2c-846e-a045897ad632 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb" returned: 0 in 0.681s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:29 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb is being set with open permissions: ugo+rw Jul 03 01:28:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:29 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb Jul 03 01:28:29 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:30 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb" returned: 0 in 0.640s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:30 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.info Jul 03 01:28:30 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:30 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.info" returned: 0 in 0.631s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:30 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.info is being set with open permissions: ugo+rw Jul 03 01:28:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:30 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.info Jul 03 01:28:30 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:31 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.info" returned: 0 in 0.652s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.412s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.796s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] Creating offline snapshot 262230fd-79dd-4104-8f8e-aaacceffd600 of volume b2c4904a-7946-4729-bb9d-a5d898354c8d {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:28:31 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8d6e454a-ef55-47fe-9b95-e639c7f1aa95 tempest-ProjectMemberTests-696766750 None] Create snapshot completed successfully Jul 03 01:28:31 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[de053675-8a32-4cc7-ac17-0fcebe90f2ea]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:31 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d Jul 03 01:28:31 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:32 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d" returned: 0 in 0.734s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:32 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 1G Jul 03 01:28:32 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-4d4f5458-9f34-40e7-a951-4fde80bd04cb-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Lock "cinder-4d4f5458-9f34-40e7-a951-4fde80bd04cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-ee43f87f-3176-4e2c-846e-a045897ad632" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-ee43f87f-3176-4e2c-846e-a045897ad632" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-4d4f5458-9f34-40e7-a951-4fde80bd04cb" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-4d4f5458-9f34-40e7-a951-4fde80bd04cb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Deleting offline snapshot 4d4f5458-9f34-40e7-a951-4fde80bd04cb of volume ee43f87f-3176-4e2c-846e-a045897ad632 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] snapshot_file for this snap is: volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[983f0b77-6838-45d6-9bf5-733f6bd06c87]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:32 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb Jul 03 01:28:32 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:32 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 1G" returned: 0 in 0.789s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c4904a-7946-4729-bb9d-a5d898354c8d -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:33 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c4904a-7946-4729-bb9d-a5d898354c8d -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 Jul 03 01:28:33 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:33 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb" returned: 0 in 0.755s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee43f87f-3176-4e2c-846e-a045897ad632(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:28:33 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3290f4c0-e09c-4e2e-b9fb-81cb74d2218f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:33 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632 Jul 03 01:28:33 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:33 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c4904a-7946-4729-bb9d-a5d898354c8d -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600" returned: 0 in 0.679s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:33 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 is being set with open permissions: ugo+rw Jul 03 01:28:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:33 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 Jul 03 01:28:33 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:33 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632" returned: 0 in 0.783s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:33 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb Jul 03 01:28:33 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:34 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600" returned: 0 in 0.631s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:34 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.info Jul 03 01:28:34 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:34 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb" returned: 0 in 0.756s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:34 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb Jul 03 01:28:34 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:34 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.info" returned: 0 in 0.647s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:34 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.info is being set with open permissions: ugo+rw Jul 03 01:28:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:35 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.info Jul 03 01:28:35 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:35 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632.4d4f5458-9f34-40e7-a951-4fde80bd04cb" returned: 0 in 0.706s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-4d4f5458-9f34-40e7-a951-4fde80bd04cb" released by "_delete_snapshot" :: held 3.098s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-ee43f87f-3176-4e2c-846e-a045897ad632" released by "delete_snapshot" :: held 3.127s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Created reservations ['7665fade-d900-4c75-9234-2df94adf6f43', '05feb288-bcc8-426c-9219-f89c70d9c987', '693e3806-22f3-4fd3-8585-fc3a58ac8ec1', '00afe982-051b-4156-8ff9-120e55cf1adb'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:35 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Delete snapshot completed successfully. Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9b5564bc-79b8-4ad2-bfa6-3029c0d88980 tempest-ProjectMemberTests-696766750 None] Lock "cinder-4d4f5458-9f34-40e7-a951-4fde80bd04cb-delete_snapshot" released by "delete_snapshot" :: held 3.298s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:35 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.info" returned: 0 in 0.640s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.215s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.292s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324461420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ef2399-4dcd-473d-b21a-fbb3bde9b585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c10f5ba04764e8698ca794ae03a9049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:28Z,use_quota=True,user_id='908eac548ad749e7b79dca8a3d50c397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Creating volume 39ef2399-4dcd-473d-b21a-fbb3bde9b585 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:35 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:35 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585 1073741824 Jul 03 01:28:35 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:35 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-033a5377-fbd5-4d15-bf3f-d6a6c9c4e985 tempest-CinderUnicodeTest-1353016978 None] Create snapshot completed successfully Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "cinder-262230fd-79dd-4104-8f8e-aaacceffd600-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-262230fd-79dd-4104-8f8e-aaacceffd600-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "cinder-quobyte-b2c4904a-7946-4729-bb9d-a5d898354c8d" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-quobyte-b2c4904a-7946-4729-bb9d-a5d898354c8d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "cinder-quobyte-262230fd-79dd-4104-8f8e-aaacceffd600" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-quobyte-262230fd-79dd-4104-8f8e-aaacceffd600" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Deleting offline snapshot 262230fd-79dd-4104-8f8e-aaacceffd600 of volume b2c4904a-7946-4729-bb9d-a5d898354c8d {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] snapshot_file for this snap is: volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe22184-399c-492b-88d7-a4fa221b67b7]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:36 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 Jul 03 01:28:36 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:36 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585 1073741824" returned: 0 in 0.793s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:36 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585 Jul 03 01:28:36 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-ee43f87f-3176-4e2c-846e-a045897ad632-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Lock "cinder-ee43f87f-3176-4e2c-846e-a045897ad632-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-ee43f87f-3176-4e2c-846e-a045897ad632" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-ee43f87f-3176-4e2c-846e-a045897ad632" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3fca58-efdf-4838-91da-11bf318cdfe9]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:36 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600" returned: 0 in 0.860s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2c4904a-7946-4729-bb9d-a5d898354c8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefd2423-a843-481b-8f93-68b76206f3ba]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:37 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632 Jul 03 01:28:37 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:37 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d Jul 03 01:28:37 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:37 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585" returned: 0 in 0.666s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85455fad-558c-493a-969a-79d921fdf319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76be3e6b-417b-4c07-944d-d3f4aefbd832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:37 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Volume volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585 (39ef2399-4dcd-473d-b21a-fbb3bde9b585): created successfully Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76be3e6b-417b-4c07-944d-d3f4aefbd832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Flow 'volume_create_manager' (f331c6e3-5fd6-4359-a4cd-3919c81c99bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:37 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7ad5c57b-22df-4d6c-a318-8a3dbcb14a7e tempest-ProjectReaderTests-1879129556 None] Created volume successfully. Jul 03 01:28:37 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632" returned: 0 in 0.811s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:37 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632 Jul 03 01:28:37 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:37 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d" returned: 0 in 0.808s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:37 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 Jul 03 01:28:37 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Acquiring lock "cinder-39ef2399-4dcd-473d-b21a-fbb3bde9b585-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Lock "cinder-39ef2399-4dcd-473d-b21a-fbb3bde9b585-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Acquiring lock "cinder-quobyte-39ef2399-4dcd-473d-b21a-fbb3bde9b585" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Lock "cinder-quobyte-39ef2399-4dcd-473d-b21a-fbb3bde9b585" acquired by "delete_volume" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d48445-259a-4e5d-9956-ff0e7b8c1bfc]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:38 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585 Jul 03 01:28:38 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:38 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-ee43f87f-3176-4e2c-846e-a045897ad632" returned: 0 in 0.691s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-ee43f87f-3176-4e2c-846e-a045897ad632" released by "delete_volume" :: held 1.563s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Created reservations ['74f9225e-ae27-4e4f-99f4-188468503bd0', '768a41ef-9a78-47f8-8c2f-0ac87caa057b', 'a5b74d3d-abc4-43c9-8c66-ef1df440cd42', 'd0357de3-5010-43ee-831f-84768d416da7'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:38 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:38 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:38 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600" returned: 0 in 0.834s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:38 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600 Jul 03 01:28:38 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:38 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585" returned: 0 in 0.800s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:38 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585 Jul 03 01:28:38 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:39 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.707s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:39 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Deleted volume successfully. Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-f6ada26c-9f15-4c8d-877e-f3a725a3f205 tempest-ProjectMemberTests-696766750 None] Lock "cinder-ee43f87f-3176-4e2c-846e-a045897ad632-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:39 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d.262230fd-79dd-4104-8f8e-aaacceffd600" returned: 0 in 0.732s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-quobyte-262230fd-79dd-4104-8f8e-aaacceffd600" released by "_delete_snapshot" :: held 3.358s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-quobyte-b2c4904a-7946-4729-bb9d-a5d898354c8d" released by "delete_snapshot" :: held 3.388s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Created reservations ['fe662f2f-e50e-4c6a-9f65-1efb04e9fe20', 'dca78896-af3b-43bb-a445-d42979bea5b7', '3dd8aa99-f786-4dcd-82c0-2722a47b2a1d', '314a408d-471c-47c4-8195-f88d6aec2064'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:39 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Delete snapshot completed successfully. Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a884782-251c-479a-a25f-58bcf1db5310 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-262230fd-79dd-4104-8f8e-aaacceffd600-delete_snapshot" released by "delete_snapshot" :: held 3.556s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (be7bb9c0-f591-45e0-94f7-cfe2584d85d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c318c1-a389-4f31-bcae-aa1d633c82c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:39 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c318c1-a389-4f31-bcae-aa1d633c82c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-764367781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38a21ad-94ef-43fc-944d-f6121dd1f16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:40Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d3c271-6bdd-4fbe-a47e-d9c6a20041d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d3c271-6bdd-4fbe-a47e-d9c6a20041d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ef7b46-5077-47cb-a117-fb70c98a3d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ef7b46-5077-47cb-a117-fb70c98a3d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c38a21ad-94ef-43fc-944d-f6121dd1f16c', 'volume_name': 'volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2485658c-b313-4910-88a6-0f5500dfb4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2485658c-b313-4910-88a6-0f5500dfb4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8554d64-e147-4041-a606-788ae22ea8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:39 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Volume c38a21ad-94ef-43fc-944d-f6121dd1f16c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c', 'volume_size': 1} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-764367781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38a21ad-94ef-43fc-944d-f6121dd1f16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:40Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Creating volume c38a21ad-94ef-43fc-944d-f6121dd1f16c {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:39 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-39ef2399-4dcd-473d-b21a-fbb3bde9b585" returned: 0 in 0.859s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Lock "cinder-quobyte-39ef2399-4dcd-473d-b21a-fbb3bde9b585" released by "delete_volume" :: held 1.707s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:39 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c 1073741824 Jul 03 01:28:39 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Created reservations ['1ab2b765-336f-4ce1-aed1-9414d1dfc048', 'f81d34c2-b861-4b4a-b3b8-3fe710480ea8', '36f253e5-6415-4fa1-8248-9976bb7292e7', '139f8e49-39ff-49a7-89f6-c27a2af3c2b3'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:39 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:39 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "cinder-b2c4904a-7946-4729-bb9d-a5d898354c8d-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-b2c4904a-7946-4729-bb9d-a5d898354c8d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "cinder-quobyte-b2c4904a-7946-4729-bb9d-a5d898354c8d" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-quobyte-b2c4904a-7946-4729-bb9d-a5d898354c8d" acquired by "delete_volume" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[140ad114-1baa-48f7-84ad-cb9b90e137d9]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:40 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.734s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:40 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Deleted volume successfully. Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d968a378-92f0-4ca8-9e29-861ac80d4475 tempest-ProjectReaderTests-1879129556 None] Lock "cinder-39ef2399-4dcd-473d-b21a-fbb3bde9b585-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:40 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d Jul 03 01:28:40 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:40 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c 1073741824" returned: 0 in 1.022s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:40 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c Jul 03 01:28:40 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Flow 'volume_create_manager' (cb08a2d2-ae95-4b1c-a476-e673c4f3ca98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02f3ab8-e2ff-4693-a9c0-3ae55a434411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02f3ab8-e2ff-4693-a9c0-3ae55a434411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389411848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53959297-813c-445b-b160-6211b3363890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c10f5ba04764e8698ca794ae03a9049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:41Z,use_quota=True,user_id='908eac548ad749e7b79dca8a3d50c397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f361b917-9141-4f1a-b214-36a9468ad22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f361b917-9141-4f1a-b214-36a9468ad22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e87e04f-6a29-4477-b766-681366fa9421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e87e04f-6a29-4477-b766-681366fa9421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53959297-813c-445b-b160-6211b3363890', 'volume_name': 'volume-53959297-813c-445b-b160-6211b3363890', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be3e5fb-b27d-4579-827f-0be4d6b5c507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be3e5fb-b27d-4579-827f-0be4d6b5c507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202aeb30-5fb7-4838-aa4f-98bfb67f953b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:40 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Volume 53959297-813c-445b-b160-6211b3363890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53959297-813c-445b-b160-6211b3363890', 'volume_size': 1} Jul 03 01:28:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:41 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d" returned: 0 in 0.844s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:41 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d Jul 03 01:28:41 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:41 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c" returned: 0 in 0.700s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389411848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53959297-813c-445b-b160-6211b3363890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c10f5ba04764e8698ca794ae03a9049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:41Z,use_quota=True,user_id='908eac548ad749e7b79dca8a3d50c397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Creating volume 53959297-813c-445b-b160-6211b3363890 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:41 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-53959297-813c-445b-b160-6211b3363890 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8554d64-e147-4041-a606-788ae22ea8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:41 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-53959297-813c-445b-b160-6211b3363890 1073741824 Jul 03 01:28:41 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e65f277-f6f7-4923-9ad6-2bbf4f1cd1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:41 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Volume volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c (c38a21ad-94ef-43fc-944d-f6121dd1f16c): created successfully Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e65f277-f6f7-4923-9ad6-2bbf4f1cd1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (be7bb9c0-f591-45e0-94f7-cfe2584d85d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:41 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8f6e9f6c-8a4e-4651-a501-0da7f3324378 tempest-ProjectMemberTests-696766750 None] Created volume successfully. Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:41 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b2c4904a-7946-4729-bb9d-a5d898354c8d" returned: 0 in 0.697s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-quobyte-b2c4904a-7946-4729-bb9d-a5d898354c8d" released by "delete_volume" :: held 1.621s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Created reservations ['d160c700-12d0-4364-b1c6-8f9f30a39007', '977d2d3c-ed47-4a89-913a-f69070ede8cc', 'b51b7d09-9c53-4094-9605-c6eea8e737e4', '225f8113-3dfd-438b-9d4b-c677c721c0a6'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:42 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:42 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:42 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-53959297-813c-445b-b160-6211b3363890 1073741824" returned: 0 in 0.893s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-53959297-813c-445b-b160-6211b3363890 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:42 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-53959297-813c-445b-b160-6211b3363890 Jul 03 01:28:42 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "cinder-62227cb2-e631-453d-9247-1d594f77e3ec-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-62227cb2-e631-453d-9247-1d594f77e3ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "cinder-quobyte-62227cb2-e631-453d-9247-1d594f77e3ec" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-quobyte-62227cb2-e631-453d-9247-1d594f77e3ec" acquired by "delete_volume" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[13816bec-43b6-4d90-84a0-3e601c9ab75f]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-62227cb2-e631-453d-9247-1d594f77e3ec {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:42 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-62227cb2-e631-453d-9247-1d594f77e3ec Jul 03 01:28:42 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:42 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.686s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:42 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Deleted volume successfully. Jul 03 01:28:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e1526fe4-a3f8-4a0e-a6e3-909e903209c3 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-b2c4904a-7946-4729-bb9d-a5d898354c8d-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:43 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-53959297-813c-445b-b160-6211b3363890" returned: 0 in 0.677s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.168s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202aeb30-5fb7-4838-aa4f-98bfb67f953b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53959297-813c-445b-b160-6211b3363890', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9d2417-97fa-4326-bb36-7c2e7fd914a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] Creating offline snapshot 5cb79c00-1f5f-49b3-8dae-c7b39dddd916 of volume c38a21ad-94ef-43fc-944d-f6121dd1f16c {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:28:43 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Volume volume-53959297-813c-445b-b160-6211b3363890 (53959297-813c-445b-b160-6211b3363890): created successfully Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9d2417-97fa-4326-bb36-7c2e7fd914a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Flow 'volume_create_manager' (cb08a2d2-ae95-4b1c-a476-e673c4f3ca98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0fd4d2-605a-4833-945e-b8290da8f1da]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:43 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-739be0d4-89dd-47a4-98cc-598aa9d693cf tempest-ProjectReaderTests-1879129556 None] Created volume successfully. Jul 03 01:28:43 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c Jul 03 01:28:43 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:43 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-62227cb2-e631-453d-9247-1d594f77e3ec" returned: 0 in 0.790s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-62227cb2-e631-453d-9247-1d594f77e3ec {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:43 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-62227cb2-e631-453d-9247-1d594f77e3ec Jul 03 01:28:43 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:43 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c" returned: 0 in 0.770s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:43 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 1G Jul 03 01:28:43 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Acquiring lock "cinder-53959297-813c-445b-b160-6211b3363890-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:44 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-62227cb2-e631-453d-9247-1d594f77e3ec" returned: 0 in 0.723s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Lock "cinder-53959297-813c-445b-b160-6211b3363890-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-quobyte-62227cb2-e631-453d-9247-1d594f77e3ec" released by "delete_volume" :: held 1.567s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Acquiring lock "cinder-quobyte-53959297-813c-445b-b160-6211b3363890" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Lock "cinder-quobyte-53959297-813c-445b-b160-6211b3363890" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Created reservations ['5436a83c-d4f9-4d81-8611-d5c7751bd489', '1255713e-75c2-4805-a13d-d81d17300faf', '84c3b102-c8bd-46c2-beb3-1ae80d0c64f4', 'ddd42e03-b480-4b1e-ae5b-fe5f65935d76'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4d9885-486a-4a44-97ee-6c9c47230066]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-53959297-813c-445b-b160-6211b3363890 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:44 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:44 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:44 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-53959297-813c-445b-b160-6211b3363890 Jul 03 01:28:44 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:44 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 1G" returned: 0 in 0.909s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:44 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:44 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 Jul 03 01:28:44 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:45 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.679s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:45 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:45 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Deleted volume successfully. Jul 03 01:28:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fd441550-1719-4e1f-aec7-319d4a5b0b53 tempest-CinderUnicodeTest-1353016978 None] Lock "cinder-62227cb2-e631-453d-9247-1d594f77e3ec-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:45 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-53959297-813c-445b-b160-6211b3363890" returned: 0 in 0.966s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-53959297-813c-445b-b160-6211b3363890 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:45 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-53959297-813c-445b-b160-6211b3363890 Jul 03 01:28:45 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:45 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916" returned: 0 in 0.884s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:45 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 is being set with open permissions: ugo+rw Jul 03 01:28:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:45 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 Jul 03 01:28:45 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:46 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-53959297-813c-445b-b160-6211b3363890" returned: 0 in 0.781s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Lock "cinder-quobyte-53959297-813c-445b-b160-6211b3363890" released by "delete_volume" :: held 1.804s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Created reservations ['1812389c-955d-403f-9a11-85723fcbddef', '7de5e34d-6c23-4bee-97ca-b334655864ee', '6d61c534-4c49-4d9c-8cf3-6d874612de6d', '768d552d-fdf3-43cf-b9e4-1eaec6f98534'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:46 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:46 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:46 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916" returned: 0 in 0.842s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:46 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.info Jul 03 01:28:46 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Flow 'volume_create_manager' (7bdec9fe-1b3d-4e40-aa87-49237082ae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:46 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c507f3c7-eee9-49d7-9001-f747a07a4573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c507f3c7-eee9-49d7-9001-f747a07a4573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283049448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb37edd-9a97-4b8f-9ee6-81394af7ab0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c10f5ba04764e8698ca794ae03a9049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:47Z,use_quota=True,user_id='908eac548ad749e7b79dca8a3d50c397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b4fbd5-f9ab-42e5-b6fb-50821ac8a717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b4fbd5-f9ab-42e5-b6fb-50821ac8a717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041aa5b8-372c-4619-a18b-51491314df62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041aa5b8-372c-4619-a18b-51491314df62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb37edd-9a97-4b8f-9ee6-81394af7ab0e', 'volume_name': 'volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:47 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7280e5-4d0f-41cd-8f45-17d2de59006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7280e5-4d0f-41cd-8f45-17d2de59006e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04a48cf-da80-4851-a5c7-ab6854297496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:47 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Volume fdb37edd-9a97-4b8f-9ee6-81394af7ab0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e', 'volume_size': 1} Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.873s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:47 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Deleted volume successfully. Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-83a49f3c-b0f6-49b2-bc46-23293f1cbd39 tempest-ProjectReaderTests-1879129556 None] Lock "cinder-53959297-813c-445b-b160-6211b3363890-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:47 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.info" returned: 0 in 0.803s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:47 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.info is being set with open permissions: ugo+rw Jul 03 01:28:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:47 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.info Jul 03 01:28:47 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:48 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.info" returned: 0 in 0.691s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.017s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.040s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283049448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb37edd-9a97-4b8f-9ee6-81394af7ab0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c10f5ba04764e8698ca794ae03a9049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:47Z,use_quota=True,user_id='908eac548ad749e7b79dca8a3d50c397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Creating volume fdb37edd-9a97-4b8f-9ee6-81394af7ab0e {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:48 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:48 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e 1073741824 Jul 03 01:28:48 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:48 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-0f0c99b2-f48f-4456-9a14-b62746d5f5cc tempest-ProjectMemberTests-696766750 None] Create snapshot completed successfully Jul 03 01:28:48 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e 1073741824" returned: 0 in 0.830s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:48 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e Jul 03 01:28:48 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-5cb79c00-1f5f-49b3-8dae-c7b39dddd916-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Lock "cinder-5cb79c00-1f5f-49b3-8dae-c7b39dddd916-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-c38a21ad-94ef-43fc-944d-f6121dd1f16c" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-c38a21ad-94ef-43fc-944d-f6121dd1f16c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-5cb79c00-1f5f-49b3-8dae-c7b39dddd916" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-5cb79c00-1f5f-49b3-8dae-c7b39dddd916" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Deleting offline snapshot 5cb79c00-1f5f-49b3-8dae-c7b39dddd916 of volume c38a21ad-94ef-43fc-944d-f6121dd1f16c {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] snapshot_file for this snap is: volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f4c94b-d68a-42c7-acec-57dfa86e4a57]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:49 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 Jul 03 01:28:49 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:49 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e" returned: 0 in 0.647s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04a48cf-da80-4851-a5c7-ab6854297496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42133ec-a8e3-4940-a154-4ee88364c9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:49 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Volume volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e (fdb37edd-9a97-4b8f-9ee6-81394af7ab0e): created successfully Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42133ec-a8e3-4940-a154-4ee88364c9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Flow 'volume_create_manager' (7bdec9fe-1b3d-4e40-aa87-49237082ae85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:49 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4eed4274-fc82-48d6-a034-7aee8e94895e tempest-ProjectReaderTests-1879129556 None] Created volume successfully. Jul 03 01:28:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Acquiring lock "cinder-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:50 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916" returned: 0 in 0.851s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:50 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:28:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Lock "cinder-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:50 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa505d74-44e2-4b62-b3c1-df9e6bfd69ac]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Acquiring lock "cinder-quobyte-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Lock "cinder-quobyte-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:50 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc2b36b-30ec-4f75-91c5-9abbfcb2d66c]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:50 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c Jul 03 01:28:50 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:50 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e Jul 03 01:28:50 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:51 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c" returned: 0 in 0.845s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:51 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 Jul 03 01:28:51 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:51 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e" returned: 0 in 0.913s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:51 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e Jul 03 01:28:51 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:51 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916" returned: 0 in 0.904s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:51 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916 Jul 03 01:28:51 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:52 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e" returned: 0 in 0.848s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Lock "cinder-quobyte-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e" released by "delete_volume" :: held 1.812s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Created reservations ['78d6a654-a7e7-40a0-b602-414dbf6f65de', '3f400598-19b9-4253-979c-cdf33910dc66', '374dab0d-97b2-42b7-9ebc-97568285c4d5', 'fb0c0ea1-69e1-4195-835f-6f8c12e3c1d7'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:52 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:52 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:52 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c.5cb79c00-1f5f-49b3-8dae-c7b39dddd916" returned: 0 in 0.797s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-5cb79c00-1f5f-49b3-8dae-c7b39dddd916" released by "_delete_snapshot" :: held 3.527s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-c38a21ad-94ef-43fc-944d-f6121dd1f16c" released by "delete_snapshot" :: held 3.556s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Created reservations ['91f797f8-c77f-4e34-a002-36887b81cfee', 'c64124fe-62e0-424b-945b-d0a2949dd915', '63b39648-5382-4b3d-ba3e-84bd12079eb5', 'e0ba47c7-cff1-436e-93f9-e026e2328dc3'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:52 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Flow 'volume_create_manager' (a4e3b415-9315-4f50-a395-807ae20c31f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af23df3c-067e-45fa-9d37-80e5f9eefcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af23df3c-067e-45fa-9d37-80e5f9eefcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441583553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c32c6c-6f91-42b3-90c6-1a4fd377ea98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c10f5ba04764e8698ca794ae03a9049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:53Z,use_quota=True,user_id='908eac548ad749e7b79dca8a3d50c397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9190f6-aa20-4e11-a57b-abe9749bf742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9190f6-aa20-4e11-a57b-abe9749bf742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028b5256-e2d6-47e9-afc2-36ec6f06582b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:53 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028b5256-e2d6-47e9-afc2-36ec6f06582b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c32c6c-6f91-42b3-90c6-1a4fd377ea98', 'volume_name': 'volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe42d0e4-02da-4ace-ad28-080ef60ddeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe42d0e4-02da-4ace-ad28-080ef60ddeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75aefc61-b3b3-4a71-a36e-80f9f0bd1a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:53 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Volume 05c32c6c-6f91-42b3-90c6-1a4fd377ea98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98', 'volume_size': 1} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441583553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c32c6c-6f91-42b3-90c6-1a4fd377ea98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c10f5ba04764e8698ca794ae03a9049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:53Z,use_quota=True,user_id='908eac548ad749e7b79dca8a3d50c397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Creating volume 05c32c6c-6f91-42b3-90c6-1a4fd377ea98 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:53 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.881s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:53 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Deleted volume successfully. Jul 03 01:28:53 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Delete snapshot completed successfully. Jul 03 01:28:53 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98 1073741824 Jul 03 01:28:53 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-df8024a3-7120-4da0-8fef-82776c89ff0c tempest-ProjectMemberTests-696766750 None] Lock "cinder-5cb79c00-1f5f-49b3-8dae-c7b39dddd916-delete_snapshot" released by "delete_snapshot" :: held 3.899s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-46d8548a-3c9e-4d3e-ba70-c2bd28641143 tempest-ProjectReaderTests-1879129556 None] Lock "cinder-fdb37edd-9a97-4b8f-9ee6-81394af7ab0e-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-c38a21ad-94ef-43fc-944d-f6121dd1f16c-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Lock "cinder-c38a21ad-94ef-43fc-944d-f6121dd1f16c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-c38a21ad-94ef-43fc-944d-f6121dd1f16c" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-c38a21ad-94ef-43fc-944d-f6121dd1f16c" acquired by "delete_volume" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e921a1e-8017-463f-a7e9-f0243fc8e9c3]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:53 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c Jul 03 01:28:53 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:54 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Flow 'volume_create_manager' (dad50b90-1e8d-40c9-8bb0-789b9f36d504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab820fe3-5777-4b1f-a97e-543eb63daf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98 1073741824" returned: 0 in 1.016s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab820fe3-5777-4b1f-a97e-543eb63daf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62362006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b279b9015c6b474b8fc41bdb691b2940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:54Z,use_quota=True,user_id='ff43486091d445a291fe3cc6bf7c7ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ccb795-8bb3-4b70-bda1-72b473e1ffe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ccb795-8bb3-4b70-bda1-72b473e1ffe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e399e50-028b-4ca3-8c90-82c5ca60aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e399e50-028b-4ca3-8c90-82c5ca60aa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811', 'volume_name': 'volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927813f1-2698-418d-befb-e0f159fd4fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927813f1-2698-418d-befb-e0f159fd4fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5aec28c-e13d-4b8b-86ff-329182761d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:54 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Volume 0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811', 'volume_size': 1} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:54 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98 Jul 03 01:28:54 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:54 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c" returned: 0 in 0.847s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:54 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c Jul 03 01:28:54 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:54 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98" returned: 0 in 0.672s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62362006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b279b9015c6b474b8fc41bdb691b2940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:54Z,use_quota=True,user_id='ff43486091d445a291fe3cc6bf7c7ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Creating volume 0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:54 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75aefc61-b3b3-4a71-a36e-80f9f0bd1a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba48d90-2bc4-4a40-b73d-2ab85463e7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:54 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 1073741824 Jul 03 01:28:54 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:54 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Volume volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98 (05c32c6c-6f91-42b3-90c6-1a4fd377ea98): created successfully Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba48d90-2bc4-4a40-b73d-2ab85463e7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:54 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Flow 'volume_create_manager' (a4e3b415-9315-4f50-a395-807ae20c31f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:54 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9965116c-26e1-4c16-ac7c-55b616a57357 tempest-ProjectReaderTests-1879129556 None] Created volume successfully. Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Acquiring lock "cinder-05c32c6c-6f91-42b3-90c6-1a4fd377ea98-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:55 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c38a21ad-94ef-43fc-944d-f6121dd1f16c" returned: 0 in 0.668s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Lock "cinder-05c32c6c-6f91-42b3-90c6-1a4fd377ea98-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-c38a21ad-94ef-43fc-944d-f6121dd1f16c" released by "delete_volume" :: held 1.599s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Acquiring lock "cinder-quobyte-05c32c6c-6f91-42b3-90c6-1a4fd377ea98" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Lock "cinder-quobyte-05c32c6c-6f91-42b3-90c6-1a4fd377ea98" acquired by "delete_volume" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Created reservations ['fdab420e-7e20-47d1-b404-61660ceb0b34', '44ae671d-e620-4073-bf93-34b498e54d24', 'cd1350a2-eeda-4c87-a61c-c9c61cf13b80', '48b887b1-b87f-4e58-a810-eaddc394b30d'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e5e642-cfa7-401a-aee1-c2dbaff3aecb]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:55 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98 Jul 03 01:28:55 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:55 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:55 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:55 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 1073741824" returned: 0 in 0.863s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:55 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 Jul 03 01:28:55 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:56 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.696s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:56 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Deleted volume successfully. Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-006029e6-2f62-4b3c-845f-137b9766a567 tempest-ProjectMemberTests-696766750 None] Lock "cinder-c38a21ad-94ef-43fc-944d-f6121dd1f16c-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:56 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98" returned: 0 in 0.901s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:56 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98 Jul 03 01:28:56 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (457509ea-e80d-4fc7-89cd-3399b9d27910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b3df1d-d926-4468-8bef-1f06def6ac7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b3df1d-d926-4468-8bef-1f06def6ac7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555643151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1921aad7-54c6-4f21-b755-5b253c359118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:56Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb9c847-168e-4662-bc47-63f5b5235939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb9c847-168e-4662-bc47-63f5b5235939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3572d1-0f7e-41be-b146-2e26c838b23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3572d1-0f7e-41be-b146-2e26c838b23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1921aad7-54c6-4f21-b755-5b253c359118', 'volume_name': 'volume-1921aad7-54c6-4f21-b755-5b253c359118', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8996c982-d50c-4bea-9af5-b68973a3297c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8996c982-d50c-4bea-9af5-b68973a3297c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775e05ce-f595-497a-b240-b23f9b4a9966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:56 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Volume 1921aad7-54c6-4f21-b755-5b253c359118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1921aad7-54c6-4f21-b755-5b253c359118', 'volume_size': 1} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:56 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811" returned: 0 in 0.814s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.187s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555643151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1921aad7-54c6-4f21-b755-5b253c359118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:56Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Creating volume 1921aad7-54c6-4f21-b755-5b253c359118 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:56 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:56 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118 1073741824 Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5aec28c-e13d-4b8b-86ff-329182761d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:56 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ad28e3-4ecf-4163-9863-6b15a44aff27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:56 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Volume volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 (0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811): created successfully Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ad28e3-4ecf-4163-9863-6b15a44aff27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Flow 'volume_create_manager' (dad50b90-1e8d-40c9-8bb0-789b9f36d504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:56 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c1ea7a76-c8b6-4ce1-9709-f0cc66a89452 tempest-ProjectReaderTests-277813940 None] Created volume successfully. Jul 03 01:28:56 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-05c32c6c-6f91-42b3-90c6-1a4fd377ea98" returned: 0 in 0.676s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Lock "cinder-quobyte-05c32c6c-6f91-42b3-90c6-1a4fd377ea98" released by "delete_volume" :: held 1.618s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Created reservations ['b3831791-a866-4310-b93a-60535f743f3d', 'cb335b83-99d4-41e5-8e1e-ff4f6698db3e', '396473ad-10c7-4bd9-b899-5b712fbf8b7a', 'e5fc301d-dcca-4360-bda9-0c3aaacfe424'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:56 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:57 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:28:57 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:57 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118 1073741824" returned: 0 in 0.960s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:57 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118 Jul 03 01:28:57 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:57 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.721s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:57 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:57 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Deleted volume successfully. Jul 03 01:28:57 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a384bacd-9e6d-4669-a220-cd4d7ca6127a tempest-ProjectReaderTests-1879129556 None] Lock "cinder-05c32c6c-6f91-42b3-90c6-1a4fd377ea98-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:58 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118" returned: 0 in 0.695s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.803s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775e05ce-f595-497a-b240-b23f9b4a9966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1921aad7-54c6-4f21-b755-5b253c359118', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c9c9dc-cc04-4b4d-b277-68351d3b374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] Creating offline snapshot a25b7d75-0dac-45b9-ba7b-a9537d6ede7d of volume 0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:28:58 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Volume volume-1921aad7-54c6-4f21-b755-5b253c359118 (1921aad7-54c6-4f21-b755-5b253c359118): created successfully Jul 03 01:28:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c9c9dc-cc04-4b4d-b277-68351d3b374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:58 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (457509ea-e80d-4fc7-89cd-3399b9d27910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:58 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ee3519-f49c-4b6a-8f76-8b0d2f613b66]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:58 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-23e810a8-ec36-4c7d-9abb-a8944cadc7a7 tempest-ProjectMemberTests-696766750 None] Created volume successfully. Jul 03 01:28:58 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 Jul 03 01:28:58 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:59 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811" returned: 0 in 0.818s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:59 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d 1G Jul 03 01:28:59 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:59 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=133,cinder:INSERT=49,cinder:UPDATE=184,cinder:DELETE=19 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:28:59 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=189,cinder:SELECT=141,cinder:INSERT=51,cinder:DELETE=13 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:28:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:29:00 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d 1G" returned: 0 in 0.879s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:00 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d Jul 03 01:29:00 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:00 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d" returned: 0 in 0.699s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:00 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d is being set with open permissions: ugo+rw Jul 03 01:29:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:00 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d Jul 03 01:29:00 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:01 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d" returned: 0 in 0.615s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:01 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.info Jul 03 01:29:01 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:02 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.info" returned: 0 in 0.673s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:02 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.info is being set with open permissions: ugo+rw Jul 03 01:29:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:02 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.info Jul 03 01:29:02 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:02 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.info" returned: 0 in 0.627s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.423s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:29:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.104s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:29:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] Creating offline snapshot c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c of volume 1921aad7-54c6-4f21-b755-5b253c359118 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:29:02 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-2af40b31-b79c-4454-9447-7c7451d24cfe tempest-ProjectReaderTests-277813940 None] Create snapshot completed successfully Jul 03 01:29:02 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce327b50-6a86-4cc6-9b16-7a8bf879803a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:29:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:02 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118 Jul 03 01:29:02 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:03 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118" returned: 0 in 0.728s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:03 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c 1G Jul 03 01:29:03 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-a25b7d75-0dac-45b9-ba7b-a9537d6ede7d-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Lock "cinder-a25b7d75-0dac-45b9-ba7b-a9537d6ede7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-a25b7d75-0dac-45b9-ba7b-a9537d6ede7d" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-a25b7d75-0dac-45b9-ba7b-a9537d6ede7d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Deleting offline snapshot a25b7d75-0dac-45b9-ba7b-a9537d6ede7d of volume 0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] snapshot_file for this snap is: volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b839015-ab5c-48cd-a300-ce877a744250]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:04 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d Jul 03 01:29:04 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:04 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c 1G" returned: 0 in 0.819s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1921aad7-54c6-4f21-b755-5b253c359118 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:04 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1921aad7-54c6-4f21-b755-5b253c359118 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c Jul 03 01:29:04 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:04 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d" returned: 0 in 0.754s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[53835953-2d58-4e1f-8c15-a5ad1edb2aed]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:29:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:05 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 Jul 03 01:29:05 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:05 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1921aad7-54c6-4f21-b755-5b253c359118 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c" returned: 0 in 0.734s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:05 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c is being set with open permissions: ugo+rw Jul 03 01:29:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:05 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c Jul 03 01:29:05 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:05 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c" returned: 0 in 0.617s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:05 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811" returned: 0 in 0.816s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:05 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.info Jul 03 01:29:05 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:05 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d Jul 03 01:29:05 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:06 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.info" returned: 0 in 0.694s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:06 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.info is being set with open permissions: ugo+rw Jul 03 01:29:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:06 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.info Jul 03 01:29:06 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:06 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d" returned: 0 in 0.738s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:06 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d Jul 03 01:29:06 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:07 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-1921aad7-54c6-4f21-b755-5b253c359118.info" returned: 0 in 0.667s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.347s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:29:07 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4518f4bd-2256-4e27-a365-76922a4e081f tempest-ProjectMemberTests-696766750 None] Create snapshot completed successfully Jul 03 01:29:07 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811.a25b7d75-0dac-45b9-ba7b-a9537d6ede7d" returned: 0 in 0.692s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-a25b7d75-0dac-45b9-ba7b-a9537d6ede7d" released by "_delete_snapshot" :: held 3.097s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:29:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811" released by "delete_snapshot" :: held 3.124s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:29:07 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Created reservations ['28148f56-e8d0-4a56-a7ba-9f9c67c61cfe', '3e8a417d-2da2-464a-9703-fe0ad09dc0b4', '01bbf6df-2e81-4b56-a544-264a2fc5d10e', '6092f1c2-cfb2-47d2-8bcc-9cef2ab575b1'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:29:07 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Delete snapshot completed successfully. Jul 03 01:29:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a6b170e4-535c-4e21-af2e-4128b4657bc4 tempest-ProjectReaderTests-277813940 None] Lock "cinder-a25b7d75-0dac-45b9-ba7b-a9537d6ede7d-delete_snapshot" released by "delete_snapshot" :: held 3.267s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:29:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9c7f4ce2-eb2d-4b23-902a-129a09ed79f6 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:29:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9c7f4ce2-eb2d-4b23-902a-129a09ed79f6 tempest-ProjectMemberTests-696766750 None] Lock "cinder-c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:29:07 devstack cinder-volume[86357]: INFO cinder.message.api [None req-9c7f4ce2-eb2d-4b23-902a-129a09ed79f6 tempest-ProjectMemberTests-696766750 None] Creating message record for request_id = req-9c7f4ce2-eb2d-4b23-902a-129a09ed79f6 Jul 03 01:29:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9c7f4ce2-eb2d-4b23-902a-129a09ed79f6 tempest-ProjectMemberTests-696766750 None] Lock "cinder-c876bbe3-1e7d-4ef3-acd1-82b63cf92f1c-delete_snapshot" released by "delete_snapshot" :: held 0.032s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server [None req-9c7f4ce2-eb2d-4b23-902a-129a09ed79f6 tempest-ProjectMemberTests-696766750 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 01:29:07 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server Jul 03 01:29:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:29:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Lock "cinder-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:29:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:29:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:29:08 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a24a90b-ff45-400e-acb9-f4b58563e950]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:29:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:08 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 Jul 03 01:29:08 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:09 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811" returned: 0 in 0.750s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:09 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811 Jul 03 01:29:09 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:09 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811" returned: 0 in 0.685s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:09 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811" released by "delete_volume" :: held 1.488s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:29:09 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Created reservations ['9347c35c-fff7-43f5-b567-81a1d0fc4b35', 'b2ca3218-3c28-4e5b-a324-8771edb8e96d', '6e027a44-b635-4ccb-b91c-801865596557', '6a0bc696-d912-42b9-b512-6e9e7482c110'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:29:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:29:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:29:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:29:09 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:29:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:29:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:09 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:29:09 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:10 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.637s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:29:10 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Deleted volume successfully. Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a9760037-fd28-4e83-977b-6aa4a2863a6f tempest-ProjectReaderTests-277813940 None] Lock "cinder-0a0b26d8-9aa7-4a01-9d29-4c9aa3a5e811-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Flow 'volume_create_manager' (6d1ef963-7c0c-4682-b608-e89c59923dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4eb7ca-c650-4bc7-90b2-c51e003ac2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4eb7ca-c650-4bc7-90b2-c51e003ac2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774195595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214a0113-efe9-47e4-9d7c-15a3f13573c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b279b9015c6b474b8fc41bdb691b2940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:11Z,use_quota=True,user_id='ff43486091d445a291fe3cc6bf7c7ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fec2bd-f474-408e-bb40-d58e868f65d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fec2bd-f474-408e-bb40-d58e868f65d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6481f67f-a197-4094-81d5-70a17a6d7659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6481f67f-a197-4094-81d5-70a17a6d7659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '214a0113-efe9-47e4-9d7c-15a3f13573c7', 'volume_name': 'volume-214a0113-efe9-47e4-9d7c-15a3f13573c7', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9feb7684-be51-4511-9791-d8bfd6c80105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9feb7684-be51-4511-9791-d8bfd6c80105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4a8884-b09c-45b3-938b-e20eb26bb552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:29:10 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Volume 214a0113-efe9-47e4-9d7c-15a3f13573c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-214a0113-efe9-47e4-9d7c-15a3f13573c7', 'volume_size': 1} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774195595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214a0113-efe9-47e4-9d7c-15a3f13573c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b279b9015c6b474b8fc41bdb691b2940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:11Z,use_quota=True,user_id='ff43486091d445a291fe3cc6bf7c7ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Creating volume 214a0113-efe9-47e4-9d7c-15a3f13573c7 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:29:10 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:29:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:11 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 1073741824 Jul 03 01:29:11 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:11 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 1073741824" returned: 0 in 0.771s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:11 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 Jul 03 01:29:11 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:12 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7" returned: 0 in 0.616s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:29:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:29:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4a8884-b09c-45b3-938b-e20eb26bb552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-214a0113-efe9-47e4-9d7c-15a3f13573c7', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:29:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e43154-5691-4aef-8332-826c25bcf68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:29:12 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Volume volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 (214a0113-efe9-47e4-9d7c-15a3f13573c7): created successfully Jul 03 01:29:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e43154-5691-4aef-8332-826c25bcf68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:29:12 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Flow 'volume_create_manager' (6d1ef963-7c0c-4682-b608-e89c59923dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:29:12 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d5b8831c-ae08-4d60-aa55-94d525dfb0e8 tempest-ProjectReaderTests-277813940 None] Created volume successfully. Jul 03 01:29:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:29:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:29:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] Creating offline snapshot 38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d of volume 214a0113-efe9-47e4-9d7c-15a3f13573c7 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:29:13 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acfa8c9-f2dd-48b5-9a28-f71b6db6a873]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:29:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:13 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 Jul 03 01:29:13 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:13 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7" returned: 0 in 0.733s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:13 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d 1G Jul 03 01:29:13 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:14 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d 1G" returned: 0 in 0.824s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:14 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d Jul 03 01:29:14 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:15 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d" returned: 0 in 0.659s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:15 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d is being set with open permissions: ugo+rw Jul 03 01:29:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:15 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d Jul 03 01:29:15 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:16 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d" returned: 0 in 0.625s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:16 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.info Jul 03 01:29:16 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:16 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.info" returned: 0 in 0.624s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:16 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.info is being set with open permissions: ugo+rw Jul 03 01:29:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:16 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.info Jul 03 01:29:16 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:17 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.info" returned: 0 in 0.669s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.212s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:29:17 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8f12e88c-1bdf-4147-aac6-f22fa2b5254c tempest-ProjectReaderTests-277813940 None] Create snapshot completed successfully Jul 03 01:29:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:29:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Lock "cinder-38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:29:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-214a0113-efe9-47e4-9d7c-15a3f13573c7" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:29:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-214a0113-efe9-47e4-9d7c-15a3f13573c7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:29:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:29:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:29:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Deleting offline snapshot 38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d of volume 214a0113-efe9-47e4-9d7c-15a3f13573c7 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:29:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] snapshot_file for this snap is: volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:29:18 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0fb88b-bf61-4d42-9231-ca865991d0e2]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:29:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:18 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d Jul 03 01:29:18 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:19 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d" returned: 0 in 0.736s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-214a0113-efe9-47e4-9d7c-15a3f13573c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:29:19 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[919877f8-3a7f-44a9-b735-42f0c62a8044]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:29:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:19 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 Jul 03 01:29:19 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:20 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7" returned: 0 in 0.763s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:20 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d Jul 03 01:29:20 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:20 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d" returned: 0 in 0.691s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:20 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d Jul 03 01:29:20 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:21 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7.38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d" returned: 0 in 0.681s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d" released by "_delete_snapshot" :: held 2.954s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:29:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-214a0113-efe9-47e4-9d7c-15a3f13573c7" released by "delete_snapshot" :: held 3.013s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:29:21 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Created reservations ['c09c36d0-bd64-435b-b9c1-50edbcc63197', 'a9b60ac1-ddb9-4b40-be30-90b51e817ce2', '1d41c5f5-3f98-46bb-9dc1-7414387e1c2f', '2c1a1a3d-4b43-4272-bc7f-76f623b1aeaa'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:29:21 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Delete snapshot completed successfully. Jul 03 01:29:21 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9edfb839-07af-41ff-b432-c1eca0c95ce7 tempest-ProjectReaderTests-277813940 None] Lock "cinder-38ee8fa7-5829-4ba2-81d9-a4f4e1c1b17d-delete_snapshot" released by "delete_snapshot" :: held 3.146s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:29:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-214a0113-efe9-47e4-9d7c-15a3f13573c7-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:29:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Lock "cinder-214a0113-efe9-47e4-9d7c-15a3f13573c7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:29:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-214a0113-efe9-47e4-9d7c-15a3f13573c7" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:29:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-214a0113-efe9-47e4-9d7c-15a3f13573c7" acquired by "delete_volume" :: waited 0.013s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:29:22 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[41545824-c8ab-4866-a053-f9230351ff74]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:29:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:22 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 Jul 03 01:29:22 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:23 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7" returned: 0 in 0.775s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:23 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7 Jul 03 01:29:23 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:24 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-214a0113-efe9-47e4-9d7c-15a3f13573c7" returned: 0 in 0.641s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-214a0113-efe9-47e4-9d7c-15a3f13573c7" released by "delete_volume" :: held 1.467s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:29:24 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Created reservations ['bb171022-f007-4228-85ea-c20a585005c2', '96e40951-f5a3-4344-b46f-a1d5c4e4f258', 'c2da3089-c90e-4b1d-91ed-86560d7ca8c3', 'a863a2dc-f70c-414d-b093-27fa366444be'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:29:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:29:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:29:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:29:24 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:29:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:29:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:24 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:29:24 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:24 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.639s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:24 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:29:24 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Deleted volume successfully. Jul 03 01:29:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-5e7d7400-b103-4a67-a25a-3e593af22552 tempest-ProjectReaderTests-277813940 None] Lock "cinder-214a0113-efe9-47e4-9d7c-15a3f13573c7-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Flow 'volume_create_manager' (cf75a83a-7f76-4e82-a1f8-192841438b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b66203-3d3b-486b-8457-1a8bea57fb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b66203-3d3b-486b-8457-1a8bea57fb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1935344900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f72a10-5f62-4fa8-806a-2de9efd1e2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b279b9015c6b474b8fc41bdb691b2940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:25Z,use_quota=True,user_id='ff43486091d445a291fe3cc6bf7c7ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b2a203-2fd9-4ae4-8ab7-70f4d4d69ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b2a203-2fd9-4ae4-8ab7-70f4d4d69ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6def04c4-21d2-4221-8011-1098fddf6c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6def04c4-21d2-4221-8011-1098fddf6c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f72a10-5f62-4fa8-806a-2de9efd1e2c0', 'volume_name': 'volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6f565d-f865-4e60-a44e-b169c616504a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6f565d-f865-4e60-a44e-b169c616504a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36f53f4-3ffb-459b-a3e4-bcead31abff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:29:25 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Volume c6f72a10-5f62-4fa8-806a-2de9efd1e2c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0', 'volume_size': 1} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1935344900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f72a10-5f62-4fa8-806a-2de9efd1e2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b279b9015c6b474b8fc41bdb691b2940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:25Z,use_quota=True,user_id='ff43486091d445a291fe3cc6bf7c7ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Creating volume c6f72a10-5f62-4fa8-806a-2de9efd1e2c0 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:29:25 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:29:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:25 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0 1073741824 Jul 03 01:29:25 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:26 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0 1073741824" returned: 0 in 0.849s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:26 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0 Jul 03 01:29:26 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:26 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0" returned: 0 in 0.627s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:29:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:29:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36f53f4-3ffb-459b-a3e4-bcead31abff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:29:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd5b159-5bde-4400-b616-06c84c1314c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:29:26 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Volume volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0 (c6f72a10-5f62-4fa8-806a-2de9efd1e2c0): created successfully Jul 03 01:29:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd5b159-5bde-4400-b616-06c84c1314c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:29:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Flow 'volume_create_manager' (cf75a83a-7f76-4e82-a1f8-192841438b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:29:26 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3bd17322-1869-4143-90c5-86544b52fd9c tempest-ProjectReaderTests-277813940 None] Created volume successfully. Jul 03 01:29:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:29:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:29:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] Creating offline snapshot fc479082-dc0b-4a9b-932a-ba50da4aad3a of volume c6f72a10-5f62-4fa8-806a-2de9efd1e2c0 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:29:27 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd4f85a-d0d0-4455-a1fe-f514bad22866]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:29:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:27 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0 Jul 03 01:29:27 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:29:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:29:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:29:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:29:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:29:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:29:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:27 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:29:27 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:28 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0" returned: 0 in 0.725s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.fc479082-dc0b-4a9b-932a-ba50da4aad3a 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:28 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.fc479082-dc0b-4a9b-932a-ba50da4aad3a 1G Jul 03 01:29:28 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:28 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.670s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:29:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:29:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:29:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:29:28 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.fc479082-dc0b-4a9b-932a-ba50da4aad3a 1G" returned: 0 in 0.785s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.fc479082-dc0b-4a9b-932a-ba50da4aad3a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:29 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.fc479082-dc0b-4a9b-932a-ba50da4aad3a Jul 03 01:29:29 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:29 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.fc479082-dc0b-4a9b-932a-ba50da4aad3a" returned: 0 in 0.670s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:29 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.fc479082-dc0b-4a9b-932a-ba50da4aad3a is being set with open permissions: ugo+rw Jul 03 01:29:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.fc479082-dc0b-4a9b-932a-ba50da4aad3a {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:29 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.fc479082-dc0b-4a9b-932a-ba50da4aad3a Jul 03 01:29:29 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:30 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.fc479082-dc0b-4a9b-932a-ba50da4aad3a" returned: 0 in 0.710s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:30 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.info Jul 03 01:29:30 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:31 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.info" returned: 0 in 0.634s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:31 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.info is being set with open permissions: ugo+rw Jul 03 01:29:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:31 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.info Jul 03 01:29:31 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:31 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-c6f72a10-5f62-4fa8-806a-2de9efd1e2c0.info" returned: 0 in 0.671s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.273s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:29:31 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-b8a4e417-519d-44a3-90cf-a2fb322f09ab tempest-ProjectReaderTests-277813940 None] Create snapshot completed successfully Jul 03 01:29:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9598c2fb-e090-459b-a1fa-f0740f435f0a tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-fc479082-dc0b-4a9b-932a-ba50da4aad3a-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:29:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9598c2fb-e090-459b-a1fa-f0740f435f0a tempest-ProjectReaderTests-277813940 None] Lock "cinder-fc479082-dc0b-4a9b-932a-ba50da4aad3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:29:32 devstack cinder-volume[86357]: INFO cinder.message.api [None req-9598c2fb-e090-459b-a1fa-f0740f435f0a tempest-ProjectReaderTests-277813940 None] Creating message record for request_id = req-9598c2fb-e090-459b-a1fa-f0740f435f0a Jul 03 01:29:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9598c2fb-e090-459b-a1fa-f0740f435f0a tempest-ProjectReaderTests-277813940 None] Lock "cinder-fc479082-dc0b-4a9b-932a-ba50da4aad3a-delete_snapshot" released by "delete_snapshot" :: held 0.036s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server [None req-9598c2fb-e090-459b-a1fa-f0740f435f0a tempest-ProjectReaderTests-277813940 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 01:29:32 devstack cinder-volume[86357]: ERROR oslo_messaging.rpc.server Jul 03 01:29:41 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=27,cinder:UPDATE=46,cinder:DELETE=5,cinder:INSERT=12 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:29:42 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=36,cinder:UPDATE=32,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:30:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:30:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:30:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:30:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:30:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:30:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:30:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:30:27 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:30:27 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:30:28 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 03 01:30:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.616s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:30:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:30:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:30:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:30:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:30:33 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=1 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:30:33 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=1 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:31:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:31:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:31:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:31:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:31:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:31:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:31:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:27 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:31:27 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:28 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.619s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:31:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:31:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:31:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (9ecd7fbd-79d1-4e34-8b69-77be408509c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df4e715-9501-48ca-a053-3e81bfca73d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df4e715-9501-48ca-a053-3e81bfca73d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1985200438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fba89b-d310-40ec-b5c5-0c57e5312cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:24Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016b98d5-67c4-4a2b-b1d8-29e40b140190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016b98d5-67c4-4a2b-b1d8-29e40b140190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54ba223-f43d-4466-8276-9407f434866d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54ba223-f43d-4466-8276-9407f434866d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8fba89b-d310-40ec-b5c5-0c57e5312cf7', 'volume_name': 'volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035f7ccd-a6c4-4ba7-9b2c-b80f9c846b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035f7ccd-a6c4-4ba7-9b2c-b80f9c846b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c52bfa2-62af-4ac3-9291-da86ef685d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:23 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Volume e8fba89b-d310-40ec-b5c5-0c57e5312cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7', 'volume_size': 1} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1985200438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fba89b-d310-40ec-b5c5-0c57e5312cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:24Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Creating volume e8fba89b-d310-40ec-b5c5-0c57e5312cf7 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:32:23 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:32:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:23 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 1073741824 Jul 03 01:32:23 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:24 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 1073741824" returned: 0 in 0.792s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:24 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 Jul 03 01:32:24 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:25 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7" returned: 0 in 0.696s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:32:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c52bfa2-62af-4ac3-9291-da86ef685d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea3fb71-3271-44ba-a51f-06f6103ebe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:25 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Volume volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 (e8fba89b-d310-40ec-b5c5-0c57e5312cf7): created successfully Jul 03 01:32:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea3fb71-3271-44ba-a51f-06f6103ebe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:25 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (9ecd7fbd-79d1-4e34-8b69-77be408509c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-3bb4fef2-a7d0-4d96-aec0-0b990aded611 tempest-ProjectMemberTests-696766750 None] Created volume successfully. Jul 03 01:32:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] Creating offline snapshot 03fb0eff-08fc-4f50-9095-7aa9d400ed14 of volume e8fba89b-d310-40ec-b5c5-0c57e5312cf7 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:32:26 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b020c8-4c26-4624-b9b5-b855d9bff17b]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:26 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 Jul 03 01:32:26 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:26 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7" returned: 0 in 0.726s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:26 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 1G Jul 03 01:32:26 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:27 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 1G" returned: 0 in 0.774s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:27 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 Jul 03 01:32:27 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:32:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:27 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:32:27 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:28 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14" returned: 0 in 0.652s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:28 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 is being set with open permissions: ugo+rw Jul 03 01:32:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:28 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 Jul 03 01:32:28 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:28 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.703s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:32:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:32:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:32:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:32:28 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14" returned: 0 in 0.641s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:28 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.info Jul 03 01:32:28 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:29 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.info" returned: 0 in 0.624s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:29 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.info is being set with open permissions: ugo+rw Jul 03 01:32:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:29 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.info Jul 03 01:32:29 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:30 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.info" returned: 0 in 0.627s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.123s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:30 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-16a58321-a371-428f-9bd0-e224b3b59fce tempest-ProjectMemberTests-696766750 None] Create snapshot completed successfully Jul 03 01:32:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-03fb0eff-08fc-4f50-9095-7aa9d400ed14-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Lock "cinder-03fb0eff-08fc-4f50-9095-7aa9d400ed14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-e8fba89b-d310-40ec-b5c5-0c57e5312cf7" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-e8fba89b-d310-40ec-b5c5-0c57e5312cf7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-03fb0eff-08fc-4f50-9095-7aa9d400ed14" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-03fb0eff-08fc-4f50-9095-7aa9d400ed14" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Deleting offline snapshot 03fb0eff-08fc-4f50-9095-7aa9d400ed14 of volume e8fba89b-d310-40ec-b5c5-0c57e5312cf7 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:32:31 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] snapshot_file for this snap is: volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:32:31 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60b4f52-37f6-478f-9f1b-daf065e306ab]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:31 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 Jul 03 01:32:31 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:32 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14" returned: 0 in 0.724s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:32:32 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddb8863-0ec3-4254-b822-267ac762f5ec]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:32 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 Jul 03 01:32:32 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:32 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7" returned: 0 in 0.710s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:32 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 Jul 03 01:32:32 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:33 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14" returned: 0 in 0.706s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:33 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14 Jul 03 01:32:33 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:34 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7.03fb0eff-08fc-4f50-9095-7aa9d400ed14" returned: 0 in 0.613s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-03fb0eff-08fc-4f50-9095-7aa9d400ed14" released by "_delete_snapshot" :: held 2.834s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-e8fba89b-d310-40ec-b5c5-0c57e5312cf7" released by "delete_snapshot" :: held 2.856s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:34 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Created reservations ['1ded81a6-2710-4b49-b549-7db48c9cff87', 'ab1a64b5-2de1-4ac0-a2ae-fbda73944319', 'c03537b9-7de5-4db7-ac3a-60830444c2ca', '51e91257-fb27-4ca8-95f8-7bc08dc12185'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:34 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Delete snapshot completed successfully. Jul 03 01:32:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-dacbb88b-50d6-46ac-ac3b-60aa0bf9ba30 tempest-ProjectMemberTests-696766750 None] Lock "cinder-03fb0eff-08fc-4f50-9095-7aa9d400ed14-delete_snapshot" released by "delete_snapshot" :: held 2.995s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-e8fba89b-d310-40ec-b5c5-0c57e5312cf7-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Lock "cinder-e8fba89b-d310-40ec-b5c5-0c57e5312cf7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-e8fba89b-d310-40ec-b5c5-0c57e5312cf7" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-e8fba89b-d310-40ec-b5c5-0c57e5312cf7" acquired by "delete_volume" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:34 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b1c42e-cf0a-404d-b294-e18f0d827268]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:34 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 Jul 03 01:32:34 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:35 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7" returned: 0 in 0.804s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:35 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7 Jul 03 01:32:35 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:35 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-e8fba89b-d310-40ec-b5c5-0c57e5312cf7" returned: 0 in 0.615s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-e8fba89b-d310-40ec-b5c5-0c57e5312cf7" released by "delete_volume" :: held 1.476s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:36 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Created reservations ['9bed57f3-e02d-4e3a-9a2f-0565bb75dca5', 'fbf7794f-0626-4b7f-a0ec-64588cc7f08a', '957c13c8-f5d8-49bd-8ed8-45d331e90f75', 'a357336e-a279-4ff8-9afa-c0fa3779d013'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:36 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:32:36 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:36 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.624s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:36 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:32:36 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Deleted volume successfully. Jul 03 01:32:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-2a41fad4-ba67-49ce-bf73-5dc0c7ee6768 tempest-ProjectMemberTests-696766750 None] Lock "cinder-e8fba89b-d310-40ec-b5c5-0c57e5312cf7-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (c13aedfb-379f-460f-bd83-99f01dbd319b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b64ae0e-e7e1-42ad-a592-d1d8cf74b2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b64ae0e-e7e1-42ad-a592-d1d8cf74b2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1741712413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b2aadd-2c61-41aa-8abe-18e1e637d6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:37Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6796c009-5fd3-42f8-b9d7-4a30fbd2025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6796c009-5fd3-42f8-b9d7-4a30fbd2025b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18deaa8c-46d5-4e15-81de-8eb70480ee39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18deaa8c-46d5-4e15-81de-8eb70480ee39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7b2aadd-2c61-41aa-8abe-18e1e637d6ae', 'volume_name': 'volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2ca215-42fc-4548-88cd-2e09556b9294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2ca215-42fc-4548-88cd-2e09556b9294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc91d92-7e47-4e24-8e2d-d6061d85864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:37 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Volume b7b2aadd-2c61-41aa-8abe-18e1e637d6ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae', 'volume_size': 1} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1741712413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b2aadd-2c61-41aa-8abe-18e1e637d6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:37Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Creating volume b7b2aadd-2c61-41aa-8abe-18e1e637d6ae {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:32:37 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:32:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:37 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae 1073741824 Jul 03 01:32:37 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:38 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae 1073741824" returned: 0 in 0.788s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:38 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae Jul 03 01:32:38 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:38 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae" returned: 0 in 0.611s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:38 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:32:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc91d92-7e47-4e24-8e2d-d6061d85864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fd5489-b398-4ee9-8104-a43d22e2b354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:38 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Volume volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae (b7b2aadd-2c61-41aa-8abe-18e1e637d6ae): created successfully Jul 03 01:32:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fd5489-b398-4ee9-8104-a43d22e2b354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:38 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (c13aedfb-379f-460f-bd83-99f01dbd319b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:38 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-01ab2ed6-a40f-462e-81d6-cf82fad48cf2 tempest-ProjectMemberTests-696766750 None] Created volume successfully. Jul 03 01:32:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] Creating offline snapshot ae71fd60-675d-4e4a-8c53-0d8bb40558f4 of volume b7b2aadd-2c61-41aa-8abe-18e1e637d6ae {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:32:39 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[114166a8-c39a-442e-90af-f0aef4925c1c]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:39 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae Jul 03 01:32:39 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:40 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae" returned: 0 in 0.773s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:40 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 1G Jul 03 01:32:40 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:41 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 1G" returned: 0 in 0.864s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:41 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 Jul 03 01:32:41 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:41 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4" returned: 0 in 0.672s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:41 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 is being set with open permissions: ugo+rw Jul 03 01:32:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:41 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 Jul 03 01:32:41 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:42 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4" returned: 0 in 0.613s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:42 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.info Jul 03 01:32:42 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:43 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.info" returned: 0 in 0.628s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:43 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.info is being set with open permissions: ugo+rw Jul 03 01:32:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:43 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.info Jul 03 01:32:43 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:43 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.info" returned: 0 in 0.643s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.286s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:43 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-78d9e041-82de-4bd9-b960-262b872825e5 tempest-ProjectMemberTests-696766750 None] Create snapshot completed successfully Jul 03 01:32:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-ae71fd60-675d-4e4a-8c53-0d8bb40558f4-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Lock "cinder-ae71fd60-675d-4e4a-8c53-0d8bb40558f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:44 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-ae71fd60-675d-4e4a-8c53-0d8bb40558f4" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:45 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-ae71fd60-675d-4e4a-8c53-0d8bb40558f4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Deleting offline snapshot ae71fd60-675d-4e4a-8c53-0d8bb40558f4 of volume b7b2aadd-2c61-41aa-8abe-18e1e637d6ae {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:32:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] snapshot_file for this snap is: volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:32:45 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[35003b9e-4256-4356-8611-6cae14bf1f0c]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:45 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 Jul 03 01:32:45 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:45 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4" returned: 0 in 0.744s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:45 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:32:45 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[086bd681-29a7-4299-8e6a-45e07b68ded4]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:45 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:45 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae Jul 03 01:32:45 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:46 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae" returned: 0 in 0.726s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:46 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:46 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 Jul 03 01:32:46 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:47 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4" returned: 0 in 0.748s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:47 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4 Jul 03 01:32:47 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:47 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:47 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae.ae71fd60-675d-4e4a-8c53-0d8bb40558f4" returned: 0 in 0.625s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-ae71fd60-675d-4e4a-8c53-0d8bb40558f4" released by "_delete_snapshot" :: held 2.935s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:47 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae" released by "delete_snapshot" :: held 2.961s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:48 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Created reservations ['ae04f7c3-cdf7-48b1-a557-1c6d05304cf0', 'bcf62d7e-03bb-4064-b3f9-7c2699b05ccb', '19320a67-6cc0-456e-b4dc-45c1a7332c38', '740ed42b-4916-41d7-93a5-875d2823af69'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:48 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Delete snapshot completed successfully. Jul 03 01:32:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-a153f5aa-b3a2-478a-85cc-a7cb8e2daa9f tempest-ProjectMemberTests-696766750 None] Lock "cinder-ae71fd60-675d-4e4a-8c53-0d8bb40558f4-delete_snapshot" released by "delete_snapshot" :: held 3.104s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Lock "cinder-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:48 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae" acquired by "delete_volume" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:48 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fffe80-85ff-4423-b085-04b1f4a3dc21]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:48 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:48 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae Jul 03 01:32:48 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:49 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae" returned: 0 in 0.757s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:49 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae Jul 03 01:32:49 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Flow 'volume_create_manager' (f8895082-7139-4ac2-8316-dbde117907fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a26c4e1-baff-48a4-960f-3c0b509f6d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a26c4e1-baff-48a4-960f-3c0b509f6d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643708587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8396b3f1-fc6d-41d7-90c7-1aecd2d9d294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b279b9015c6b474b8fc41bdb691b2940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:50Z,use_quota=True,user_id='ff43486091d445a291fe3cc6bf7c7ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f10ac1-a276-4ce8-a5b0-845e9d7a19af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f10ac1-a276-4ce8-a5b0-845e9d7a19af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fc999e-ccd1-478f-bef5-a49a35a0c0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fc999e-ccd1-478f-bef5-a49a35a0c0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8396b3f1-fc6d-41d7-90c7-1aecd2d9d294', 'volume_name': 'volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e672a99e-954b-49b1-9425-5210e5e03d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e672a99e-954b-49b1-9425-5210e5e03d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4737f0db-ff52-46e3-b4e1-469611da19b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:49 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Volume 8396b3f1-fc6d-41d7-90c7-1aecd2d9d294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294', 'volume_size': 1} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643708587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8396b3f1-fc6d-41d7-90c7-1aecd2d9d294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b279b9015c6b474b8fc41bdb691b2940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:50Z,use_quota=True,user_id='ff43486091d445a291fe3cc6bf7c7ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Creating volume 8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:32:49 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:49 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 1073741824 Jul 03 01:32:49 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:49 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae" returned: 0 in 0.677s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae" released by "delete_volume" :: held 1.495s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Created reservations ['59558433-3473-4b11-897a-5bc99f881d60', '62f431b6-fad8-44c7-8cb6-3763e4d035f4', '1ad64886-e4bd-4ce1-a715-dc474f32f3ff', '63d4c79e-09bc-44bc-93c4-cbd116597866'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:49 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:49 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:32:49 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:50 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.700s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:50 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:32:50 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Deleted volume successfully. Jul 03 01:32:50 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-4a27923c-7d0f-432c-9418-8027014c7ae1 tempest-ProjectMemberTests-696766750 None] Lock "cinder-b7b2aadd-2c61-41aa-8abe-18e1e637d6ae-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:50 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 1073741824" returned: 0 in 0.917s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:50 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:50 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 Jul 03 01:32:50 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:50 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:32:50 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (ac87738f-f103-4971-b855-30530dbad998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:50 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7194ae46-23d8-4506-b12e-d86ff2c6dea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:50 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7194ae46-23d8-4506-b12e-d86ff2c6dea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1508292928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:51Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:50 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cc0c96-66a1-4848-8118-ed2eab535f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:50 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cc0c96-66a1-4848-8118-ed2eab535f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:50 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffb8723-c607-4817-bf94-d7a0b3fbcce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:50 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffb8723-c607-4817-bf94-d7a0b3fbcce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b', 'volume_name': 'volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe9ced7-1420-4585-9837-937fb55a66c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe9ced7-1420-4585-9837-937fb55a66c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863335e3-a095-4840-949b-3b5a17dc357f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:51 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Volume cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b', 'volume_size': 1} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:51 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294" returned: 0 in 0.639s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.254s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1508292928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:51Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Creating volume cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:32:51 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4737f0db-ff52-46e3-b4e1-469611da19b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:51 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b 1073741824 Jul 03 01:32:51 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecdf225-a2a7-4d01-bb04-f29d575cc154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:51 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Volume volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 (8396b3f1-fc6d-41d7-90c7-1aecd2d9d294): created successfully Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecdf225-a2a7-4d01-bb04-f29d575cc154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Flow 'volume_create_manager' (f8895082-7139-4ac2-8316-dbde117907fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:51 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-2cf946f1-a230-4c06-9d26-c4741a415acc tempest-ProjectReaderTests-277813940 None] Created volume successfully. Jul 03 01:32:51 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:52 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b 1073741824" returned: 0 in 0.818s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:52 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b Jul 03 01:32:52 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:52 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b" returned: 0 in 0.629s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:32:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.876s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863335e3-a095-4840-949b-3b5a17dc357f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e68a50d-f191-4073-864e-4e942cacb544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:52 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] Creating offline snapshot 8ce9c861-4722-4701-b4b3-4901d7c6984c of volume 8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:32:52 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Volume volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b (cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b): created successfully Jul 03 01:32:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e68a50d-f191-4073-864e-4e942cacb544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:52 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (ac87738f-f103-4971-b855-30530dbad998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:52 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[453475b5-d5b7-44aa-bf8f-861fd1efdb02]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:52 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:52 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ca9045da-3fc6-4e7a-816e-4610a4fb3c0b tempest-ProjectMemberTests-696766750 None] Created volume successfully. Jul 03 01:32:52 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 Jul 03 01:32:52 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:53 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294" returned: 0 in 0.771s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:53 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:53 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c 1G Jul 03 01:32:53 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:54 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c 1G" returned: 0 in 0.778s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:54 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:54 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c Jul 03 01:32:54 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:55 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c" returned: 0 in 0.687s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:55 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c is being set with open permissions: ugo+rw Jul 03 01:32:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:55 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c Jul 03 01:32:55 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:55 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c" returned: 0 in 0.619s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:55 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:55 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.info Jul 03 01:32:55 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:56 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.info" returned: 0 in 0.649s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:56 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.info is being set with open permissions: ugo+rw Jul 03 01:32:56 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:56 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.info Jul 03 01:32:56 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:57 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.info" returned: 0 in 0.640s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.257s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.840s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:57 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] Creating offline snapshot f5686312-f60a-4103-95cf-3e7d99b03f18 of volume cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:32:57 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[61369bbf-c30b-4ade-bb8c-0eb4cf9afb45]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:57 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-ccad7946-e350-4b3a-875a-89bc1da07ecf tempest-ProjectReaderTests-277813940 None] Create snapshot completed successfully Jul 03 01:32:57 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b Jul 03 01:32:57 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:57 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b" returned: 0 in 0.720s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:57 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 1G Jul 03 01:32:57 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-8ce9c861-4722-4701-b4b3-4901d7c6984c-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Lock "cinder-8ce9c861-4722-4701-b4b3-4901d7c6984c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-8ce9c861-4722-4701-b4b3-4901d7c6984c" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-8ce9c861-4722-4701-b4b3-4901d7c6984c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Deleting offline snapshot 8ce9c861-4722-4701-b4b3-4901d7c6984c of volume 8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] snapshot_file for this snap is: volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[1967444a-cefe-466b-97f6-1f523162453e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:58 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c Jul 03 01:32:58 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:58 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 1G" returned: 0 in 0.776s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:58 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 Jul 03 01:32:58 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:58 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c" returned: 0 in 0.766s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:58 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:32:59 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8882a14-60d4-44ea-a028-8c70ddef9e44]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:59 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 Jul 03 01:32:59 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:59 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18" returned: 0 in 0.659s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:59 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 is being set with open permissions: ugo+rw Jul 03 01:32:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:59 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 Jul 03 01:32:59 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:59 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294" returned: 0 in 0.760s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:59 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c Jul 03 01:32:59 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:59 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18" returned: 0 in 0.632s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:59 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:59 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.info Jul 03 01:32:59 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:00 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.info" returned: 0 in 0.669s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:00 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.info is being set with open permissions: ugo+rw Jul 03 01:33:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:00 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c" returned: 0 in 0.775s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:00 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:00 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.info Jul 03 01:33:00 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:00 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c Jul 03 01:33:00 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:01 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.info" returned: 0 in 0.613s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.148s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:01 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-c74f8fd9-74b7-49ae-b438-b45df1329cd3 tempest-ProjectMemberTests-696766750 None] Create snapshot completed successfully Jul 03 01:33:01 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294.8ce9c861-4722-4701-b4b3-4901d7c6984c" returned: 0 in 0.650s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-8ce9c861-4722-4701-b4b3-4901d7c6984c" released by "_delete_snapshot" :: held 3.043s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294" released by "delete_snapshot" :: held 3.064s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Created reservations ['c9fe52f3-6b28-437e-a9be-1595e2b096fa', 'e0253e84-f4c0-423b-9de7-69413d665d03', '85741ff6-8e92-4e51-ae9e-77767e137f67', '5741afa0-fdf5-4f7a-a9b5-fa31f1dbba58'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:01 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Delete snapshot completed successfully. Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-7664e890-5965-4459-a470-01a697da9825 tempest-ProjectReaderTests-277813940 None] Lock "cinder-8ce9c861-4722-4701-b4b3-4901d7c6984c-delete_snapshot" released by "delete_snapshot" :: held 3.199s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-f5686312-f60a-4103-95cf-3e7d99b03f18-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Lock "cinder-f5686312-f60a-4103-95cf-3e7d99b03f18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-f5686312-f60a-4103-95cf-3e7d99b03f18" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-f5686312-f60a-4103-95cf-3e7d99b03f18" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Deleting offline snapshot f5686312-f60a-4103-95cf-3e7d99b03f18 of volume cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] snapshot_file for this snap is: volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccbfde0-bbdc-4246-8a49-2095390a54c7]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:01 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:01 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 Jul 03 01:33:01 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:02 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18" returned: 0 in 0.738s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:02 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:33:02 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[035e9f8e-21eb-4a77-8847-95e8d79dd269]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Lock "cinder-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:02 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:02 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b Jul 03 01:33:02 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:02 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a641d288-2c43-446d-8a15-8f40330c8690]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:02 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:02 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 Jul 03 01:33:02 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:03 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b" returned: 0 in 0.773s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:03 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 Jul 03 01:33:03 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:03 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294" returned: 0 in 0.739s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:03 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294 Jul 03 01:33:03 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:03 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18" returned: 0 in 0.735s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:03 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18 Jul 03 01:33:03 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:03 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294" returned: 0 in 0.655s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:03 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294" released by "delete_volume" :: held 1.446s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:03 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Created reservations ['3d6266bc-ffb2-4b5a-a604-b80bf80e24c1', 'c3eb4a2b-73e8-4316-bbb0-de7f1aba3895', '45eccdf3-7d2d-48cd-86bc-b3fa96284a52', '7c4ec945-11a9-46a1-a899-345d924f7915'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:03 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:04 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:04 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:33:04 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:04 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b.f5686312-f60a-4103-95cf-3e7d99b03f18" returned: 0 in 0.626s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-f5686312-f60a-4103-95cf-3e7d99b03f18" released by "_delete_snapshot" :: held 2.973s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b" released by "delete_snapshot" :: held 3.003s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:04 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Created reservations ['55d89163-3a96-4b38-bade-b1c481e30749', 'd65f95ef-fd30-41a6-a7fb-cb836c036321', '08bd4283-4777-4682-a91c-014459fbb691', '81d4f690-551a-4ac4-8f8e-0f61ef1bad05'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:04 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:04 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.651s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:04 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:04 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Deleted volume successfully. Jul 03 01:33:04 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Delete snapshot completed successfully. Jul 03 01:33:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-37b81faa-cccb-4dea-8305-b5ba7bfd1263 tempest-ProjectMemberTests-696766750 None] Lock "cinder-f5686312-f60a-4103-95cf-3e7d99b03f18-delete_snapshot" released by "delete_snapshot" :: held 3.179s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:04 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-d676837b-41e7-4112-b32f-87b387546e99 tempest-ProjectReaderTests-277813940 None] Lock "cinder-8396b3f1-fc6d-41d7-90c7-1aecd2d9d294-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Flow 'volume_create_manager' (d1ada36e-27ce-4638-827e-a17c04c255b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e093f13-13c1-4b35-98c8-5f99d3cf3605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e093f13-13c1-4b35-98c8-5f99d3cf3605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-400583657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f349ae06-98b7-46e0-82b4-22b856c02c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b279b9015c6b474b8fc41bdb691b2940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:05Z,use_quota=True,user_id='ff43486091d445a291fe3cc6bf7c7ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c9f801-6df7-459a-a302-95da63a8298c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c9f801-6df7-459a-a302-95da63a8298c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebf8320-3070-41dc-b87c-87a6d858b63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebf8320-3070-41dc-b87c-87a6d858b63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f349ae06-98b7-46e0-82b4-22b856c02c8c', 'volume_name': 'volume-f349ae06-98b7-46e0-82b4-22b856c02c8c', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d51bf8e-575a-4b82-a4bd-1cefb05b2e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d51bf8e-575a-4b82-a4bd-1cefb05b2e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0153ec64-751e-41b3-9ffe-f957b3cf8a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:05 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Volume f349ae06-98b7-46e0-82b4-22b856c02c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f349ae06-98b7-46e0-82b4-22b856c02c8c', 'volume_size': 1} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-400583657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f349ae06-98b7-46e0-82b4-22b856c02c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b279b9015c6b474b8fc41bdb691b2940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:05Z,use_quota=True,user_id='ff43486091d445a291fe3cc6bf7c7ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Creating volume f349ae06-98b7-46e0-82b4-22b856c02c8c {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:33:05 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:05 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c 1073741824 Jul 03 01:33:05 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Lock "cinder-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b" acquired by "delete_volume" :: waited 0.017s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[4706c378-c6e5-4460-a665-44783a678e07]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:05 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b Jul 03 01:33:05 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:05 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:05 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c 1073741824" returned: 0 in 0.849s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:06 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c Jul 03 01:33:06 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:06 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b" returned: 0 in 0.747s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:06 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b Jul 03 01:33:06 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:06 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c" returned: 0 in 0.658s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:06 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:33:06 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0153ec64-751e-41b3-9ffe-f957b3cf8a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f349ae06-98b7-46e0-82b4-22b856c02c8c', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae626ad-5b6b-49f6-83b5-22cf38002c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:06 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Volume volume-f349ae06-98b7-46e0-82b4-22b856c02c8c (f349ae06-98b7-46e0-82b4-22b856c02c8c): created successfully Jul 03 01:33:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae626ad-5b6b-49f6-83b5-22cf38002c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:06 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Flow 'volume_create_manager' (d1ada36e-27ce-4638-827e-a17c04c255b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:06 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1b2f84aa-0076-4051-9cd4-4acfa6063876 tempest-ProjectReaderTests-277813940 None] Created volume successfully. Jul 03 01:33:07 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b" returned: 0 in 0.659s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b" released by "delete_volume" :: held 1.473s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] Creating offline snapshot 776dd799-7c23-4e24-9a8d-34e32b6db579 of volume f349ae06-98b7-46e0-82b4-22b856c02c8c {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1be7ea-a904-4159-bc50-68c6403221c2]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Created reservations ['645afd90-29c4-40e0-a5ba-9cbb80d300db', 'e85531de-81a8-4ace-aaa9-610eaa0166cd', 'e045682b-0c8b-40ab-88b2-70d5ae394419', 'e15a408b-e4b0-4dda-8d69-bee02fb1b850'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:07 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:07 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:33:07 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:07 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c Jul 03 01:33:07 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:08 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.653s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:08 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Deleted volume successfully. Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-fda1a470-119a-4634-aa4d-c565704b543c tempest-ProjectMemberTests-696766750 None] Lock "cinder-cb7ba57b-7804-4290-a7a8-a1e8f1f8c18b-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:08 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c" returned: 0 in 0.780s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:08 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 1G Jul 03 01:33:08 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (07b082e5-cf64-49d0-9c0f-261924eeaf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90dc2bb4-d551-477b-9ea3-9ef37e109c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90dc2bb4-d551-477b-9ea3-9ef37e109c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-765829059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93abb935-9eaf-453c-b051-49ef85e2d7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:08Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd05d063-4d7a-4c59-b423-b2d4fa7968c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd05d063-4d7a-4c59-b423-b2d4fa7968c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee162296-ace1-411e-bfc4-247107939638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee162296-ace1-411e-bfc4-247107939638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93abb935-9eaf-453c-b051-49ef85e2d7f8', 'volume_name': 'volume-93abb935-9eaf-453c-b051-49ef85e2d7f8', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0edd548-a6f7-4013-9671-b5114d8e92f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0edd548-a6f7-4013-9671-b5114d8e92f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f58054-02a3-40a1-b6ad-d34939b14ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:08 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Volume 93abb935-9eaf-453c-b051-49ef85e2d7f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93abb935-9eaf-453c-b051-49ef85e2d7f8', 'volume_size': 1} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:08 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 1G" returned: 0 in 0.809s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:08 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f349ae06-98b7-46e0-82b4-22b856c02c8c -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:08 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f349ae06-98b7-46e0-82b4-22b856c02c8c -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 Jul 03 01:33:08 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:09 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f349ae06-98b7-46e0-82b4-22b856c02c8c -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579" returned: 0 in 0.699s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:09 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 is being set with open permissions: ugo+rw Jul 03 01:33:09 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:09 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 Jul 03 01:33:09 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:10 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579" returned: 0 in 0.683s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:10 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:10 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.info Jul 03 01:33:10 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:11 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.info" returned: 0 in 0.682s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:11 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.info is being set with open permissions: ugo+rw Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:11 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.info Jul 03 01:33:11 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:11 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.info" returned: 0 in 0.656s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.390s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.209s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-765829059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93abb935-9eaf-453c-b051-49ef85e2d7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:08Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Creating volume 93abb935-9eaf-453c-b051-49ef85e2d7f8 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:33:11 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:33:11 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:11 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 1073741824 Jul 03 01:33:11 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:11 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6b2b9aae-220c-43d8-91a5-c20244849f76 tempest-ProjectReaderTests-277813940 None] Create snapshot completed successfully Jul 03 01:33:12 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-776dd799-7c23-4e24-9a8d-34e32b6db579-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 1073741824" returned: 0 in 0.824s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Lock "cinder-776dd799-7c23-4e24-9a8d-34e32b6db579-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-f349ae06-98b7-46e0-82b4-22b856c02c8c" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-f349ae06-98b7-46e0-82b4-22b856c02c8c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-776dd799-7c23-4e24-9a8d-34e32b6db579" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:12 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-776dd799-7c23-4e24-9a8d-34e32b6db579" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Deleting offline snapshot 776dd799-7c23-4e24-9a8d-34e32b6db579 of volume f349ae06-98b7-46e0-82b4-22b856c02c8c {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:33:12 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] snapshot_file for this snap is: volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:33:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:12 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[b149d115-03d3-4b25-b9b2-fd5cb26ce913]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:12 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:12 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 Jul 03 01:33:12 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:12 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 Jul 03 01:33:12 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:13 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8" returned: 0 in 0.620s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f58054-02a3-40a1-b6ad-d34939b14ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93abb935-9eaf-453c-b051-49ef85e2d7f8', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d262d1-ad65-40f9-bf34-2aa2e91b139e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:13 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Volume volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 (93abb935-9eaf-453c-b051-49ef85e2d7f8): created successfully Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d262d1-ad65-40f9-bf34-2aa2e91b139e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (07b082e5-cf64-49d0-9c0f-261924eeaf34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:13 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-34c28cc1-7909-4ef6-8f46-472e103365b3 tempest-ProjectMemberTests-696766750 None] Created volume successfully. Jul 03 01:33:13 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579" returned: 0 in 0.769s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f349ae06-98b7-46e0-82b4-22b856c02c8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba04a14-4bb6-4f5a-a61c-f99157a0cfec]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:13 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c Jul 03 01:33:13 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] Creating offline snapshot d25e791e-f81c-4d78-bd31-a32192744351 of volume 93abb935-9eaf-453c-b051-49ef85e2d7f8 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69cb93b-3183-4289-a31e-01fe6f6238f6]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:13 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:13 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 Jul 03 01:33:13 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:14 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c" returned: 0 in 0.761s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:14 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 Jul 03 01:33:14 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:14 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8" returned: 0 in 0.789s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:14 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 1G Jul 03 01:33:14 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:14 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579" returned: 0 in 0.728s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:14 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:14 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579 Jul 03 01:33:14 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:15 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 1G" returned: 0 in 0.808s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:15 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 Jul 03 01:33:15 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:15 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:15 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c.776dd799-7c23-4e24-9a8d-34e32b6db579" returned: 0 in 0.672s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-776dd799-7c23-4e24-9a8d-34e32b6db579" released by "_delete_snapshot" :: held 3.036s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-f349ae06-98b7-46e0-82b4-22b856c02c8c" released by "delete_snapshot" :: held 3.072s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:15 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=82,cinder:SELECT=55,cinder:INSERT=23,cinder:DELETE=4 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:33:15 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=75,cinder:INSERT=20,cinder:UPDATE=79,cinder:DELETE=11 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:33:15 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Created reservations ['be97dd16-db19-4f69-a70b-762f0afe8729', 'fb797e7c-e36a-440d-b3cd-72e441cda694', '7866f5f9-46cc-44b2-bcc0-aa146f873e46', 'ae917b97-2327-4077-b4a8-3559d1b2cc1f'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:15 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Delete snapshot completed successfully. Jul 03 01:33:15 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9356fa14-742a-4afd-bd15-fa6eb9dc1b43 tempest-ProjectReaderTests-277813940 None] Lock "cinder-776dd799-7c23-4e24-9a8d-34e32b6db579-delete_snapshot" released by "delete_snapshot" :: held 3.237s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:16 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351" returned: 0 in 0.691s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:16 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 is being set with open permissions: ugo+rw Jul 03 01:33:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:16 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 Jul 03 01:33:16 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-f349ae06-98b7-46e0-82b4-22b856c02c8c-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Lock "cinder-f349ae06-98b7-46e0-82b4-22b856c02c8c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:16 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351" returned: 0 in 0.641s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-f349ae06-98b7-46e0-82b4-22b856c02c8c" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:16 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-f349ae06-98b7-46e0-82b4-22b856c02c8c" acquired by "delete_volume" :: waited 0.032s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:16 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.info Jul 03 01:33:16 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:16 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[b617f660-3cdd-49fb-952d-9e3d2fb1e1fb]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:16 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:17 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c Jul 03 01:33:17 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:17 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.info" returned: 0 in 0.668s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:17 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.info is being set with open permissions: ugo+rw Jul 03 01:33:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:17 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.info Jul 03 01:33:17 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:17 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c" returned: 0 in 0.767s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:17 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:17 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c Jul 03 01:33:17 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:18 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.info" returned: 0 in 0.648s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.343s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:18 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-83820c05-3d23-4600-a7e3-1a0e491b5aa4 tempest-ProjectMemberTests-696766750 None] Create snapshot completed successfully Jul 03 01:33:18 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-f349ae06-98b7-46e0-82b4-22b856c02c8c" returned: 0 in 0.723s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:18 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-f349ae06-98b7-46e0-82b4-22b856c02c8c" released by "delete_volume" :: held 1.566s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:18 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Created reservations ['8365eb66-a84e-4f1c-8ea6-d9a30d88a078', '7eadd37e-e870-440a-93df-87d98d46414d', 'dc9272e2-713a-4361-8d47-84ce81984134', 'd644b535-d846-4fd6-ba68-19929e8ab2d7'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:18 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:18 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:18 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:33:18 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-d25e791e-f81c-4d78-bd31-a32192744351-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Lock "cinder-d25e791e-f81c-4d78-bd31-a32192744351-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-93abb935-9eaf-453c-b051-49ef85e2d7f8" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-93abb935-9eaf-453c-b051-49ef85e2d7f8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-d25e791e-f81c-4d78-bd31-a32192744351" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-d25e791e-f81c-4d78-bd31-a32192744351" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Deleting offline snapshot d25e791e-f81c-4d78-bd31-a32192744351 of volume 93abb935-9eaf-453c-b051-49ef85e2d7f8 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] snapshot_file for this snap is: volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:33:19 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.659s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[611511c3-f2e3-4f23-bbdf-b3f416faafc0]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:19 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Deleted volume successfully. Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8dad178d-e483-488d-b6b6-517d88e9533d tempest-ProjectReaderTests-277813940 None] Lock "cinder-f349ae06-98b7-46e0-82b4-22b856c02c8c-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:19 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 Jul 03 01:33:19 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Flow 'volume_create_manager' (fe930f50-15cd-405b-bda1-bd7d9492a55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458680e1-3ec7-4b78-aca2-6e0f6e1f7f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458680e1-3ec7-4b78-aca2-6e0f6e1f7f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1798785364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380f5353-336c-4b38-b6cc-6e0381080778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b279b9015c6b474b8fc41bdb691b2940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:19Z,use_quota=True,user_id='ff43486091d445a291fe3cc6bf7c7ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6aebed8-d8b5-441e-8dd1-34fab706c555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6aebed8-d8b5-441e-8dd1-34fab706c555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bdd293-20d3-4c5c-898b-b08ef220fe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bdd293-20d3-4c5c-898b-b08ef220fe96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '380f5353-336c-4b38-b6cc-6e0381080778', 'volume_name': 'volume-380f5353-336c-4b38-b6cc-6e0381080778', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f926ba-6d9d-48f5-8368-faf7cb2f8e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f926ba-6d9d-48f5-8368-faf7cb2f8e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af458aac-1761-4346-b760-2da19a1b5c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:19 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Volume 380f5353-336c-4b38-b6cc-6e0381080778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-380f5353-336c-4b38-b6cc-6e0381080778', 'volume_size': 1} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1798785364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380f5353-336c-4b38-b6cc-6e0381080778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b279b9015c6b474b8fc41bdb691b2940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:19Z,use_quota=True,user_id='ff43486091d445a291fe3cc6bf7c7ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Creating volume 380f5353-336c-4b38-b6cc-6e0381080778 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:33:19 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:19 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778 1073741824 Jul 03 01:33:19 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:19 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351" returned: 0 in 0.765s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93abb935-9eaf-453c-b051-49ef85e2d7f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:33:20 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f04e4c2-4ae9-48cf-9c11-1da58914c3d9]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:20 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 Jul 03 01:33:20 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:20 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778 1073741824" returned: 0 in 0.890s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:20 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778 Jul 03 01:33:20 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:20 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8" returned: 0 in 0.781s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:20 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 Jul 03 01:33:20 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:21 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778" returned: 0 in 0.650s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af458aac-1761-4346-b760-2da19a1b5c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-380f5353-336c-4b38-b6cc-6e0381080778', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35e828e-e169-4094-92bf-1133bc20a1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:21 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Volume volume-380f5353-336c-4b38-b6cc-6e0381080778 (380f5353-336c-4b38-b6cc-6e0381080778): created successfully Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35e828e-e169-4094-92bf-1133bc20a1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Flow 'volume_create_manager' (fe930f50-15cd-405b-bda1-bd7d9492a55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:21 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-0527b70e-c072-4299-8bd0-1159326274c8 tempest-ProjectReaderTests-277813940 None] Created volume successfully. Jul 03 01:33:21 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351" returned: 0 in 0.738s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:21 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351 Jul 03 01:33:21 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] Creating offline snapshot 3d33659e-5f10-4bff-a780-fe9418209dc3 of volume 380f5353-336c-4b38-b6cc-6e0381080778 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d044d6b4-4ab7-4925-9c42-2503e5bea567]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:21 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778 Jul 03 01:33:21 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:22 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8.d25e791e-f81c-4d78-bd31-a32192744351" returned: 0 in 0.659s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-d25e791e-f81c-4d78-bd31-a32192744351" released by "_delete_snapshot" :: held 3.041s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-93abb935-9eaf-453c-b051-49ef85e2d7f8" released by "delete_snapshot" :: held 3.069s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:22 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Created reservations ['98e8cee6-646d-4c58-b64f-261af1e728f2', '7fb5b040-8bf2-4785-a81c-2ccd77cb1d89', '4ce120b0-588c-417f-90fc-fdcbc4614968', 'dbdd6c8e-bd2d-4b46-9661-50d4788cdd4d'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:22 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Delete snapshot completed successfully. Jul 03 01:33:22 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-eb1abaf4-03de-49a7-b887-fafb660fe94a tempest-ProjectMemberTests-696766750 None] Lock "cinder-d25e791e-f81c-4d78-bd31-a32192744351-delete_snapshot" released by "delete_snapshot" :: held 3.216s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:22 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778" returned: 0 in 0.730s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:22 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 1G Jul 03 01:33:22 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:23 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 1G" returned: 0 in 0.805s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-380f5353-336c-4b38-b6cc-6e0381080778 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:23 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-380f5353-336c-4b38-b6cc-6e0381080778 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 Jul 03 01:33:23 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-93abb935-9eaf-453c-b051-49ef85e2d7f8-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Lock "cinder-93abb935-9eaf-453c-b051-49ef85e2d7f8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-93abb935-9eaf-453c-b051-49ef85e2d7f8" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:23 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-93abb935-9eaf-453c-b051-49ef85e2d7f8" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:23 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[899ecb6c-42ca-41e1-ae5c-999cf950b581]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:23 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 Jul 03 01:33:23 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:23 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-380f5353-336c-4b38-b6cc-6e0381080778 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3" returned: 0 in 0.669s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:23 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 is being set with open permissions: ugo+rw Jul 03 01:33:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:23 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 Jul 03 01:33:23 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:24 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8" returned: 0 in 0.772s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:24 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8 Jul 03 01:33:24 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:24 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3" returned: 0 in 0.634s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:24 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.info Jul 03 01:33:24 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:24 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-93abb935-9eaf-453c-b051-49ef85e2d7f8" returned: 0 in 0.635s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:24 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-93abb935-9eaf-453c-b051-49ef85e2d7f8" released by "delete_volume" :: held 1.465s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:24 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Created reservations ['4a271711-c22b-41f1-b9a0-8f5512c96c07', 'f695e161-48f9-46dd-9018-5fb7b1b272a8', 'dac33f46-700d-4d53-a441-8e4f9b338555', '780cd508-21ae-474c-96b1-86aee63509a2'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:25 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:25 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:33:25 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:25 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.info" returned: 0 in 0.627s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:25 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.info is being set with open permissions: ugo+rw Jul 03 01:33:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:25 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.info Jul 03 01:33:25 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:25 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.641s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:25 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Deleted volume successfully. Jul 03 01:33:25 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-78e34bf3-6235-452c-8233-a426c1b73726 tempest-ProjectMemberTests-696766750 None] Lock "cinder-93abb935-9eaf-453c-b051-49ef85e2d7f8-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:25 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.info" returned: 0 in 0.690s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.243s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e481cb42-92a7-4a3d-b846-7f2243ef038f tempest-ProjectReaderTests-277813940 None] Create snapshot completed successfully Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (cb73c596-ad14-491e-b763-134ee60a8f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f076558a-7a24-403e-8c9b-5578ec492032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f076558a-7a24-403e-8c9b-5578ec492032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156602252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db74521-347a-495b-83fe-e361aa499020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:26Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073177e1-488b-4c92-bec9-c88db3196a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073177e1-488b-4c92-bec9-c88db3196a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656d64fa-e6f7-4002-908d-2b3817b87825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656d64fa-e6f7-4002-908d-2b3817b87825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db74521-347a-495b-83fe-e361aa499020', 'volume_name': 'volume-0db74521-347a-495b-83fe-e361aa499020', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c65d016-a8fb-4ea3-8c19-d021b9a964f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c65d016-a8fb-4ea3-8c19-d021b9a964f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6d755d-9eb6-4094-a521-5d8104d25046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:26 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Volume 0db74521-347a-495b-83fe-e361aa499020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db74521-347a-495b-83fe-e361aa499020', 'volume_size': 1} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156602252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db74521-347a-495b-83fe-e361aa499020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6082f43bfd2842e19d6c4ebfd253ee68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:26Z,use_quota=True,user_id='e2aaa9d5cd5148fdb3f338fa64d9f1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Creating volume 0db74521-347a-495b-83fe-e361aa499020 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:33:26 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:26 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020 1073741824 Jul 03 01:33:26 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:26 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020 1073741824" returned: 0 in 0.787s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-3d33659e-5f10-4bff-a780-fe9418209dc3-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Lock "cinder-3d33659e-5f10-4bff-a780-fe9418209dc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-380f5353-336c-4b38-b6cc-6e0381080778" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-380f5353-336c-4b38-b6cc-6e0381080778" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:26 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-3d33659e-5f10-4bff-a780-fe9418209dc3" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-3d33659e-5f10-4bff-a780-fe9418209dc3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:27 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020 Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Deleting offline snapshot 3d33659e-5f10-4bff-a780-fe9418209dc3 of volume 380f5353-336c-4b38-b6cc-6e0381080778 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:33:27 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] snapshot_file for this snap is: volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7ab08d-e295-4d47-81a9-c78c503904c7]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:27 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 Jul 03 01:33:27 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:27 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020" returned: 0 in 0.635s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6d755d-9eb6-4094-a521-5d8104d25046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db74521-347a-495b-83fe-e361aa499020', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d12f5de-0db3-4a32-b209-28e67b01a720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:27 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Volume volume-0db74521-347a-495b-83fe-e361aa499020 (0db74521-347a-495b-83fe-e361aa499020): created successfully Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d12f5de-0db3-4a32-b209-28e67b01a720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Flow 'volume_create_manager' (cb73c596-ad14-491e-b763-134ee60a8f73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:27 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-7b7d72a9-401e-44b6-9ec2-c295164f7f74 tempest-ProjectMemberTests-696766750 None] Created volume successfully. Jul 03 01:33:27 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3" returned: 0 in 0.755s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-380f5353-336c-4b38-b6cc-6e0381080778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf0059d-fbb4-4c1c-a094-4e32b6f9a01e]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:27 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778 Jul 03 01:33:27 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:27 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:33:27 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] Creating offline snapshot 923d9a15-4fa0-4082-9f89-fca54aa258e1 of volume 0db74521-347a-495b-83fe-e361aa499020 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:33:28 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[e097806d-9cb5-45dc-bcec-4611919cbbb1]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:28 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020 Jul 03 01:33:28 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:28 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.688s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:28 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:33:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:33:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:33:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778" returned: 0 in 0.788s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:28 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 Jul 03 01:33:28 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:29 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020" returned: 0 in 0.784s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:29 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 1G Jul 03 01:33:29 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:29 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3" returned: 0 in 0.762s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:29 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3 Jul 03 01:33:29 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:29 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 1G" returned: 0 in 0.846s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0db74521-347a-495b-83fe-e361aa499020 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:29 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0db74521-347a-495b-83fe-e361aa499020 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 Jul 03 01:33:29 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:30 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778.3d33659e-5f10-4bff-a780-fe9418209dc3" returned: 0 in 0.752s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-3d33659e-5f10-4bff-a780-fe9418209dc3" released by "_delete_snapshot" :: held 3.153s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-380f5353-336c-4b38-b6cc-6e0381080778" released by "delete_snapshot" :: held 3.177s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:30 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Created reservations ['5899a4af-c2e0-49a8-a661-5579d36ae16f', '668acc68-8049-4cfb-9010-62cc03236f19', 'd3e01e83-9af4-4b4d-8191-5650061c6592', 'b1eeec95-db26-4d50-81eb-758d51a9d838'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:30 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Delete snapshot completed successfully. Jul 03 01:33:30 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-e46abdfb-5725-424b-af3c-7477fd37a4fc tempest-ProjectReaderTests-277813940 None] Lock "cinder-3d33659e-5f10-4bff-a780-fe9418209dc3-delete_snapshot" released by "delete_snapshot" :: held 3.339s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:30 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0db74521-347a-495b-83fe-e361aa499020 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1" returned: 0 in 0.736s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:30 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 is being set with open permissions: ugo+rw Jul 03 01:33:30 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:30 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 Jul 03 01:33:30 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-380f5353-336c-4b38-b6cc-6e0381080778-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Lock "cinder-380f5353-336c-4b38-b6cc-6e0381080778-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Acquiring lock "cinder-quobyte-380f5353-336c-4b38-b6cc-6e0381080778" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:31 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-380f5353-336c-4b38-b6cc-6e0381080778" acquired by "delete_volume" :: waited 0.022s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:31 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc633433-84be-4ae5-96d1-6d261ad5bdba]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:31 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1" returned: 0 in 0.681s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:31 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778 Jul 03 01:33:31 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:31 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:31 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.info Jul 03 01:33:31 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:32 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778" returned: 0 in 0.776s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:32 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.info" returned: 0 in 0.676s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:32 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.info is being set with open permissions: ugo+rw Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:32 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778 Jul 03 01:33:32 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:32 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.info Jul 03 01:33:32 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:32 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-380f5353-336c-4b38-b6cc-6e0381080778" returned: 0 in 0.656s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Lock "cinder-quobyte-380f5353-336c-4b38-b6cc-6e0381080778" released by "delete_volume" :: held 1.494s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:32 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.info" returned: 0 in 0.688s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.489s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:32 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-a0a8b0a1-4375-4b60-934c-6b0d57bdeb67 tempest-ProjectMemberTests-696766750 None] Create snapshot completed successfully Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Created reservations ['5805efe4-2eed-48c6-ad88-6390bb827636', 'be8c4318-e598-4934-88e3-eb984ec61580', '2b7ef92b-5894-4a91-a3d1-7fd69e102f2d', '92f1b77f-2888-4c1f-9f38-891dd21fb031'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:32 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:32 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:33:32 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:33 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.693s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:33 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:33 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Deleted volume successfully. Jul 03 01:33:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-96f11501-4af3-4fcd-ab5c-c381fd4f91bc tempest-ProjectReaderTests-277813940 None] Lock "cinder-380f5353-336c-4b38-b6cc-6e0381080778-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-923d9a15-4fa0-4082-9f89-fca54aa258e1-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Lock "cinder-923d9a15-4fa0-4082-9f89-fca54aa258e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-0db74521-347a-495b-83fe-e361aa499020" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-0db74521-347a-495b-83fe-e361aa499020" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-923d9a15-4fa0-4082-9f89-fca54aa258e1" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:33 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-923d9a15-4fa0-4082-9f89-fca54aa258e1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Deleting offline snapshot 923d9a15-4fa0-4082-9f89-fca54aa258e1 of volume 0db74521-347a-495b-83fe-e361aa499020 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:33:33 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] snapshot_file for this snap is: volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:33:33 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a263b8bb-5891-43c4-971c-e4178ce007fa]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:33 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 Jul 03 01:33:33 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:34 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1" returned: 0 in 0.797s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:34 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0db74521-347a-495b-83fe-e361aa499020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:33:34 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7763d35-3515-4b05-9484-34f9ce6df187]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:34 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020 Jul 03 01:33:34 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:35 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020" returned: 0 in 0.811s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:35 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:35 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 Jul 03 01:33:35 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:36 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1" returned: 0 in 0.741s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:36 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1 Jul 03 01:33:36 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:36 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020.923d9a15-4fa0-4082-9f89-fca54aa258e1" returned: 0 in 0.639s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-923d9a15-4fa0-4082-9f89-fca54aa258e1" released by "_delete_snapshot" :: held 3.115s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-0db74521-347a-495b-83fe-e361aa499020" released by "delete_snapshot" :: held 3.139s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:36 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Created reservations ['e307fb55-24df-49f3-8d1f-b2ab221c6df7', '3c2e5e39-ba20-4b02-90a4-db63fcf60083', 'd11f4575-6854-4e30-baf0-7f4bd396429b', '4a5c5249-a11a-45f5-a889-99403eccb4bb'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:36 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Delete snapshot completed successfully. Jul 03 01:33:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-aa4e7821-50f5-4ed7-90a2-ce97bffe0a50 tempest-ProjectMemberTests-696766750 None] Lock "cinder-923d9a15-4fa0-4082-9f89-fca54aa258e1-delete_snapshot" released by "delete_snapshot" :: held 3.300s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-0db74521-347a-495b-83fe-e361aa499020-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Lock "cinder-0db74521-347a-495b-83fe-e361aa499020-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Acquiring lock "cinder-quobyte-0db74521-347a-495b-83fe-e361aa499020" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:37 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-0db74521-347a-495b-83fe-e361aa499020" acquired by "delete_volume" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:37 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7548e9a-4e0f-426b-88ef-b620a57584cc]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:38 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020 Jul 03 01:33:38 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:38 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020" returned: 0 in 0.795s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:38 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020 Jul 03 01:33:38 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:39 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-0db74521-347a-495b-83fe-e361aa499020" returned: 0 in 0.711s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Lock "cinder-quobyte-0db74521-347a-495b-83fe-e361aa499020" released by "delete_volume" :: held 1.562s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:39 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Created reservations ['dbfcf644-f5a1-4a66-93e3-f535c44709fb', 'c7de83c2-1ea5-47e5-a796-7f2f7cd964ef', '8cc2cdd0-2be1-44d4-85c3-adef9208d009', '8515e6bd-2ff4-4a61-9a22-7c35f8399b57'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:39 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:39 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:33:39 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:40 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.670s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:40 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:40 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Deleted volume successfully. Jul 03 01:33:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-1ad8c1e5-ab56-48c4-8320-86dcc0bb747c tempest-ProjectMemberTests-696766750 None] Lock "cinder-0db74521-347a-495b-83fe-e361aa499020-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:49 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:INSERT=19,cinder:UPDATE=70,cinder:SELECT=48,cinder:DELETE=6 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:33:50 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=47,cinder:INSERT=18,cinder:UPDATE=58,cinder:DELETE=3 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Flow 'volume_create_manager' (39dc0035-65ee-4d3d-8d01-b923f0d7b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fdaaae-4df5-4cd6-a6ce-9e55e2a31166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fdaaae-4df5-4cd6-a6ce-9e55e2a31166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1073481891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5b9b24-7a1d-498d-8558-5da111cafd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4edfff58f74517b69508b5a2ef59fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:19Z,use_quota=True,user_id='fa9eee5bebfc4d7c8d69fe7655310692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e9f9af-e26c-4d60-915f-250f26a26d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e9f9af-e26c-4d60-915f-250f26a26d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2faf7bf6-b1c4-4acd-98a9-c4102ce66943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2faf7bf6-b1c4-4acd-98a9-c4102ce66943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5b9b24-7a1d-498d-8558-5da111cafd07', 'volume_name': 'volume-4e5b9b24-7a1d-498d-8558-5da111cafd07', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10428ae0-975e-4d0d-96bb-bdad3c613bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10428ae0-975e-4d0d-96bb-bdad3c613bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85eaac3e-6bc0-42e7-af45-566a6e8d5f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:34:19 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Volume 4e5b9b24-7a1d-498d-8558-5da111cafd07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5b9b24-7a1d-498d-8558-5da111cafd07', 'volume_size': 1} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1073481891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5b9b24-7a1d-498d-8558-5da111cafd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4edfff58f74517b69508b5a2ef59fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:19Z,use_quota=True,user_id='fa9eee5bebfc4d7c8d69fe7655310692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)}" {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Creating volume 4e5b9b24-7a1d-498d-8558-5da111cafd07 {{(pid=86357) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:34:19 devstack cinder-volume[86357]: INFO cinder.volume.drivers.remotefs [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] casted to osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a Jul 03 01:34:19 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 1073741824 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:19 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 1073741824 Jul 03 01:34:19 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:20 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 1073741824" returned: 0 in 0.840s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:20 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 Jul 03 01:34:20 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:20 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07" returned: 0 in 0.608s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:20 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'} {{(pid=86357) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:34:20 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:34:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85eaac3e-6bc0-42e7-af45-566a6e8d5f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5b9b24-7a1d-498d-8558-5da111cafd07', 'volume_size': 1}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:34:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0b56f7-9a4c-4e9f-900a-164616fa21ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:34:20 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Volume volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 (4e5b9b24-7a1d-498d-8558-5da111cafd07): created successfully Jul 03 01:34:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0b56f7-9a4c-4e9f-900a-164616fa21ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:34:20 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Flow 'volume_create_manager' (39dc0035-65ee-4d3d-8d01-b923f0d7b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:34:21 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-378bbfd7-2287-4500-b731-f81dd3f2fe25 tempest-SnapshotDependencyTests-85363666 None] Created volume successfully. Jul 03 01:34:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:34:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:34:21 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] Creating offline snapshot 82359daa-74f3-4c26-8188-c7f40d7148c7 of volume 4e5b9b24-7a1d-498d-8558-5da111cafd07 {{(pid=86357) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:34:21 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[32034a26-a684-4d65-8282-8125fd0baf8d]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:34:21 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:21 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 Jul 03 01:34:21 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:22 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07" returned: 0 in 0.714s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:22 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 1G {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:22 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 1G Jul 03 01:34:22 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:23 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 1G" returned: 0 in 0.758s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:23 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 Jul 03 01:34:23 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:23 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 -F qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7" returned: 0 in 0.672s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:23 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 is being set with open permissions: ugo+rw Jul 03 01:34:23 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:23 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 Jul 03 01:34:23 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:24 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7" returned: 0 in 0.626s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:24 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:24 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.info Jul 03 01:34:24 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:25 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.info" returned: 0 in 0.624s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:25 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.info is being set with open permissions: ugo+rw Jul 03 01:34:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.info {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:25 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.info Jul 03 01:34:25 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:25 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.info" returned: 0 in 0.607s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:25 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.080s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:34:25 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8d7872f1-50f9-4c85-b2fc-56ecd98cebf5 tempest-SnapshotDependencyTests-85363666 None] Create snapshot completed successfully Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.flows.manager.create_volume [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86357) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Flow 'volume_create_manager' (d0314f04-eba1-4fb4-a8d4-d751dc227c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5a92f1-309c-4fcd-8e35-05e98d3f04b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5a92f1-309c-4fcd-8e35-05e98d3f04b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4edfff58f74517b69508b5a2ef59fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=82359daa-74f3-4c26-8188-c7f40d7148c7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:27Z,use_quota=True,user_id='fa9eee5bebfc4d7c8d69fe7655310692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a889fb-e060-40dd-9e6a-fea253f0e633),volume_type_id=90a889fb-e060-40dd-9e6a-fea253f0e633)' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bc40dd-bd1e-4063-8ee8-eceb0371e74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bc40dd-bd1e-4063-8ee8-eceb0371e74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747bc837-b9e8-4ff3-8d81-7d06f2d76f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747bc837-b9e8-4ff3-8d81-7d06f2d76f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb', 'volume_name': 'volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb', 'volume_size': 1, 'snapshot_id': '82359daa-74f3-4c26-8188-c7f40d7148c7'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d6cfd2-7298-46fa-93e1-42a4a7540d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d6cfd2-7298-46fa-93e1-42a4a7540d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6032f1-4c21-4adb-a763-803e061a3d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:34:27 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Volume 4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb', 'volume_size': 1, 'snapshot_id': '82359daa-74f3-4c26-8188-c7f40d7148c7'} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "cinder-quobyte-82359daa-74f3-4c26-8188-c7f40d7148c7-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb" by "_create_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-quobyte-82359daa-74f3-4c26-8188-c7f40d7148c7-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Creating volume 4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb from snapshot 82359daa-74f3-4c26-8188-c7f40d7148c7 {{(pid=86357) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Selected osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a as target Quobyte volume. {{(pid=86357) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "cinder-quobyte-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb" by "_copy_volume_from_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-quobyte-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] snapshot: 82359daa-74f3-4c26-8188-c7f40d7148c7, volume: 4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb, {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44acb5e-1845-41d6-a53d-a8583d67ea8a]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:27 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 Jul 03 01:34:27 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:34:27 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:27 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:34:27 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:28 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7" returned: 0 in 0.735s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e5b9b24-7a1d-498d-8558-5da111cafd07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:34:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:34:28 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Creating direct copy from snapshot {{(pid=86357) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:34:28 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2a5818-e1c0-46f6-8386-6266afa65af8]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:34:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:28 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 Jul 03 01:34:28 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:28 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:28 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.648s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:28 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:34:28 devstack cinder-volume[86357]: DEBUG oslo_service.periodic_task [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] Running periodic task VolumeManager._thread_info {{(pid=86357) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:34:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread count: 28 {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:34:28 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-42e29127-fb39-4b73-9a17-f260a71769e8 None None] thread info: [<_MainThread(MainThread, started 138796453146752)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86357) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:34:29 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07" returned: 0 in 0.753s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:29 devstack cinder-volume[86357]: DEBUG cinder.utils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Path /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb not found in is_blk_device check {{(pid=86357) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:34:29 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:29 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb Jul 03 01:34:29 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:33 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb" returned: 0 in 4.172s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:33 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41d8efa-e9b0-4072-b16c-2e162c95862d]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:34:33 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:33 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 Jul 03 01:34:33 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:34 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07" returned: 0 in 0.908s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:34 devstack cinder-volume[86357]: DEBUG cinder.image.image_utils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07, size 1024.00 MB, duration 4.17 sec, destination /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb {{(pid=86357) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:34:34 devstack cinder-volume[86357]: INFO cinder.image.image_utils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Converted 1024.00 MB image at 245.39 MB/s Jul 03 01:34:34 devstack cinder-volume[86357]: WARNING cinder.volume.drivers.remotefs [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb is being set with open permissions: ugo+rw Jul 03 01:34:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:34 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb Jul 03 01:34:34 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:34 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb" returned: 0 in 0.611s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-quobyte-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb" released by "_copy_volume_from_snapshot" :: held 7.267s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:34:34 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-quobyte-82359daa-74f3-4c26-8188-c7f40d7148c7-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb" released by "_create_volume_from_snapshot" :: held 7.293s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:34:34 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.307s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:34:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6032f1-4c21-4adb-a763-803e061a3d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb', 'volume_size': 1, 'snapshot_id': '82359daa-74f3-4c26-8188-c7f40d7148c7'}' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:34:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f0a3e8-698e-40b6-8bc3-0e8ae55d2568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:34:34 devstack cinder-volume[86357]: INFO cinder.volume.flows.manager.create_volume [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Volume volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb (4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb): created successfully Jul 03 01:34:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f0a3e8-698e-40b6-8bc3-0e8ae55d2568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86357) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:34:34 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Flow 'volume_create_manager' (d0314f04-eba1-4fb4-a8d4-d751dc227c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86357) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:34:34 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-8afd1303-f44c-45d4-ace2-2a8c3b7db69c tempest-SnapshotDependencyTests-85363666 None] Created volume successfully. Jul 03 01:34:35 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "cinder-82359daa-74f3-4c26-8188-c7f40d7148c7-delete_snapshot" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:34:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-82359daa-74f3-4c26-8188-c7f40d7148c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:34:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "cinder-quobyte-4e5b9b24-7a1d-498d-8558-5da111cafd07" by "delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:34:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-quobyte-4e5b9b24-7a1d-498d-8558-5da111cafd07" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:34:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "cinder-quobyte-82359daa-74f3-4c26-8188-c7f40d7148c7" by "_delete_snapshot" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:34:36 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-quobyte-82359daa-74f3-4c26-8188-c7f40d7148c7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:34:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Deleting offline snapshot 82359daa-74f3-4c26-8188-c7f40d7148c7 of volume 4e5b9b24-7a1d-498d-8558-5da111cafd07 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:34:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] snapshot_file for this snap is: volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 {{(pid=86357) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:34:36 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc888a40-e718-43da-a177-981dad5377f4]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:34:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:36 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 Jul 03 01:34:36 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:36 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7" returned: 0 in 0.737s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:36 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.remotefs [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e5b9b24-7a1d-498d-8558-5da111cafd07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86357) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:34:36 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c97318-67d7-40b1-bf61-80850afc88e7]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:34:36 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:36 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 Jul 03 01:34:36 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:37 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07" returned: 0 in 0.724s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:37 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:37 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 Jul 03 01:34:37 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:38 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7" returned: 0 in 0.713s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:38 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7 Jul 03 01:34:38 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:38 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:38 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07.82359daa-74f3-4c26-8188-c7f40d7148c7" returned: 0 in 0.616s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-quobyte-82359daa-74f3-4c26-8188-c7f40d7148c7" released by "_delete_snapshot" :: held 2.876s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:34:38 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-quobyte-4e5b9b24-7a1d-498d-8558-5da111cafd07" released by "delete_snapshot" :: held 2.896s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:34:38 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Created reservations ['4fb9f6a9-41ca-4172-aff1-b0b0393092d6', '497ac40a-b5b6-4a2a-b9e3-4ca2a6d309ec', '213f8fcb-8e88-4fff-9055-fadda30e51bc', '917a5643-136e-4fd6-8a5a-40c56548ab00'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:34:39 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Delete snapshot completed successfully. Jul 03 01:34:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-60191b45-8f64-46c0-9999-77d33027f983 tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-82359daa-74f3-4c26-8188-c7f40d7148c7-delete_snapshot" released by "delete_snapshot" :: held 3.018s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:34:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "cinder-4e5b9b24-7a1d-498d-8558-5da111cafd07-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:34:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-4e5b9b24-7a1d-498d-8558-5da111cafd07-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:34:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "cinder-quobyte-4e5b9b24-7a1d-498d-8558-5da111cafd07" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:34:39 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-quobyte-4e5b9b24-7a1d-498d-8558-5da111cafd07" acquired by "delete_volume" :: waited 0.018s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:34:39 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2ea12a-d1bb-4504-8223-268708e5e566]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:34:39 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:39 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 Jul 03 01:34:39 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:40 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07" returned: 0 in 0.782s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:40 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07 Jul 03 01:34:40 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:40 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4e5b9b24-7a1d-498d-8558-5da111cafd07" returned: 0 in 0.617s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:40 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-quobyte-4e5b9b24-7a1d-498d-8558-5da111cafd07" released by "delete_volume" :: held 1.453s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:34:40 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Created reservations ['ca1db9cd-387b-44c0-a259-43dbecf699dc', '982366aa-0e31-4efe-b18d-e13b9f328544', '29c4b081-7227-42c5-8ac5-d1ffc550e8dc', '7c2c2274-9f9a-415f-b6cf-bebcabf72840'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:34:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:34:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:34:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:34:40 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:34:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:34:40 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:40 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:34:40 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "cinder-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb-delete_volume" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:34:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:34:41 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.644s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:41 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:34:41 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Deleted volume successfully. Jul 03 01:34:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-93a85556-c539-4ab6-ac2d-aa000af247bb tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-4e5b9b24-7a1d-498d-8558-5da111cafd07-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:34:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "cinder-quobyte-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb" by "delete_volume" {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:34:41 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-quobyte-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb" acquired by "delete_volume" :: waited 0.015s {{(pid=86357) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:34:41 devstack cinder-volume[86357]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb88dd1-cf52-441e-836d-db02b8aec4f3]: (4, 'qcow2') {{(pid=87627) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:34:41 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:41 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb Jul 03 01:34:41 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:42 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb" returned: 0 in 0.720s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:42 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb Jul 03 01:34:42 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:42 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762/volume-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb" returned: 0 in 0.613s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:42 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-quobyte-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb" released by "delete_volume" :: held 1.381s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:34:42 devstack cinder-volume[86357]: DEBUG cinder.quota [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Created reservations ['801325e4-a58a-46e7-9f33-7c5cf515a165', 'c1239238-ffb6-4db8-ab48-dd7daea42aad', 'd5cbb06f-e038-4aab-b550-36b799a5b4be', 'f1cec6fd-653e-471e-af70-214ad9d9b982'] {{(pid=86357) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:34:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:34:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:34:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a': None} {{(pid=86357) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:34:42 devstack cinder-volume[86357]: DEBUG cinder.volume.drivers.quobyte [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12a596c8-1494-4727-ac42-16831e641e1a'] {{(pid=86357) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:34:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86357) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:34:42 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:34:43 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762 Jul 03 01:34:43 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:34:43 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 03 01:34:43 devstack cinder-volume[86357]: DEBUG oslo_concurrency.processutils [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9a4b7ad7880f989ec1cd03357d89762" returned: 0 in 0.619s {{(pid=86357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:34:43 devstack cinder-volume[86357]: DEBUG cinder.manager [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Notifying Schedulers of capabilities ... {{(pid=86357) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:34:43 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Deleted volume successfully. Jul 03 01:34:43 devstack cinder-volume[86357]: DEBUG cinder.coordination [None req-9f4756ad-54eb-4fc0-b109-a16559d2639d tempest-SnapshotDependencyTests-85363666 None] Lock "cinder-4d55bbe6-d90b-48fa-b9af-74a0dc82c9bb-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=86357) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:34:52 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:UPDATE=29,cinder:SELECT=22,cinder:INSERT=10 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:34:53 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:DELETE=5,cinder:INSERT=4 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}